-- Logs begin at Mon 2022-09-19 15:33:27 UTC, end at Mon 2022-09-19 16:30:31 UTC. -- Sep 19 15:58:53.222075 dv-cinder-858370-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 15:58:53.232978 dv-cinder-858370-2-smb devstack@keystone.service[81547]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 15:58:53 2022] *** Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: nodename: dv-cinder-858370-2-smb Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: machine: x86_64 Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: clock source: unix Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: pcre jit disabled Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: detected number of CPU cores: 4 Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: current working directory: / Sep 19 15:58:53.235045 dv-cinder-858370-2-smb devstack@keystone.service[81547]: detected binary path: /usr/bin/uwsgi-core Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: your processes number limit is 47680 Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: your memory page size is 4096 bytes Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: detected max file descriptor number: 2048 Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: lock engine: pthread robust mutexes Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: thunder lock: enabled Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 15:58:53.235686 dv-cinder-858370-2-smb devstack@keystone.service[81547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 15:58:53.273969 dv-cinder-858370-2-smb devstack@keystone.service[81547]: Python main interpreter initialized at 0x55ab40c449c0 Sep 19 15:58:53.273969 dv-cinder-858370-2-smb devstack@keystone.service[81547]: python threads support enabled Sep 19 15:58:53.273969 dv-cinder-858370-2-smb devstack@keystone.service[81547]: your server socket listen backlog is limited to 100 connections Sep 19 15:58:53.273969 dv-cinder-858370-2-smb devstack@keystone.service[81547]: your mercy for graceful operations on workers is 90 seconds Sep 19 15:58:53.274275 dv-cinder-858370-2-smb devstack@keystone.service[81547]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 15:58:53.274909 dv-cinder-858370-2-smb devstack@keystone.service[81547]: *** Operational MODE: preforking *** Sep 19 15:58:53.275162 dv-cinder-858370-2-smb devstack@keystone.service[81547]: *** uWSGI is running in multiple interpreter mode *** Sep 19 15:58:53.275162 dv-cinder-858370-2-smb devstack@keystone.service[81547]: spawned uWSGI master process (pid: 81547) Sep 19 15:58:53.275347 dv-cinder-858370-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 15:58:53.276170 dv-cinder-858370-2-smb devstack@keystone.service[81547]: spawned uWSGI worker 1 (pid: 81558, cores: 1) Sep 19 15:58:53.276249 dv-cinder-858370-2-smb devstack@keystone.service[81547]: spawned uWSGI worker 2 (pid: 81559, cores: 1) Sep 19 15:58:53.278607 dv-cinder-858370-2-smb devstack@keystone.service[81547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 15:58:57.557974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:58:57.557974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: from cryptography.utils import int_from_bytes Sep 19 15:58:57.558798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:58:57.558798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: from cryptography.utils import int_from_bytes Sep 19 15:58:57.560508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:58:57.560508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: from cryptography.utils import int_from_bytes Sep 19 15:58:57.560981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:58:57.560981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: from cryptography.utils import int_from_bytes Sep 19 15:58:57.610027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:58:57.610176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:58:57.610330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] command line args: [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:58:57.610626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:58:57.610807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ================================================================================ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:58:57.611062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] admin_token = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.611307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_dir = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.611493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.611675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_source = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.611853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] debug = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.612048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:58:57.612127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.612307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:58:57.612430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] command line args: [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:58:57.612505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.612599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.612675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:58:57.612846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.612958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ================================================================================ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:58:57.613096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] admin_token = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_dir = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_config_append = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_source = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.613925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_dir = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] debug = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.614935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_config_append = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_dir = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.615982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.616935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.617956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] publish_errors = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.618993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] standard_threads = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.619934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] publish_errors = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_journal = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_json = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_stderr = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_syslog = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.620987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.621071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.621243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.621385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.621482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] standard_threads = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.621558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.621714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.621798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.621957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.622135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.622312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_journal = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.622525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_json = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_stderr = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.622851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_syslog = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.622928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:58:57.623166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.623919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.624871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.625847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.626828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.627931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.628969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.629928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.630881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.631974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.632970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.633844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.634957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.635918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.636979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.637940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.638984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.639930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.640893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.641982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.642961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.643978 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.644894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.645981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.646935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.external = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.password = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.647989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.token = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.648935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.649080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.external = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.649157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.649845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.649937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.password = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.650925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.token = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.651888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.652831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.653992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.654965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.655921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.656967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.657921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.658882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.659970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.660915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.661962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.662909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.663872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.664815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.665522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.665647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.665758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.665834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.665990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.666954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.667994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.668987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.669950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.670941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.671952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.672890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.673855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.674735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.675963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.676927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.677865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.678995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.679946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.680925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.681957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.682946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.683901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.684860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.685895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.686917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.687901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.688877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.689979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.690940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.691989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.692923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.693897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.694880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.695980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.696968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.697992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.698936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.699027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:58:57.699108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.699319 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.699556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.699806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.700042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.700286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.700519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.700761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.700996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:58:57.701166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:58:57.728674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.728893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.729111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.730962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.731192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.731414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.737368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.739600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.764926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.765153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.766839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.767068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.818565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.819316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.867093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.867263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.867356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:57.867497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.021781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.021970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.022991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.046929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.047555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.058615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.058980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.071724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.071950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.072895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.073023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.073101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.073234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 15:58:58.090125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.090335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 15:58:58.090667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.090752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.090876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 15:58:58.090957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 15:58:58.091146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 15:58:58.091475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.091984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.092157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.092410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.101532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.101811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.101945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.102080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.102221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.102363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.102527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.102811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.109423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.109846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.112367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.112659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.112766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.112944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.113858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.114976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.115162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.115240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.115426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.138385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.138720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.139830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.140118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.140203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.140445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.144796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.145083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.145168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.145366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.145448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.145640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.152335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.152625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.152708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.158206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.158520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.158606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.158809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.158891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.159913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.160004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.160174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.160253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.160437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.175750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.176272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.176476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.176754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.180175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.181141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.183977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.184275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.184387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.184682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.188514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.188884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.191814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.192143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.195041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.195986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.196235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.196813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.197074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.197208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.197338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.212871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.213158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.213286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.213410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.213539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.213666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.213816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.214047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.220542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.220964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.222096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.222517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.223656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.223947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.224074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.224322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.226655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.226951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.227235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.227985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.228245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.239094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.239381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.239520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.239650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.239779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.239916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.240958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.241211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.256910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.257165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.260400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.260644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.263330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.263619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.264809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.265102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.266280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.266591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.266750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.266874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.267008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.267261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.273337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.273605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.274885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.275119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.277780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.277986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.278957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.286592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.286775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.286922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.287061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.287191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.287331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.294036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.294265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 15:58:58.294430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.294604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.294752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.294899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.295940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.296990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.297919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.298063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.298210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 15:58:58.332656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab40c449c0 pid: 81558 (default app) Sep 19 15:58:58.332908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab40c449c0 pid: 81559 (default app) Sep 19 15:58:58.335978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0fb8-9ba0-4cd4-b987-dbd605390776 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:58:58.336265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0fb8-9ba0-4cd4-b987-dbd605390776 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:58:58.336537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0fb8-9ba0-4cd4-b987-dbd605390776 None None] PATH_INFO: `/v3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:58:58.340700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Sep 19 15:58:58 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:05.084734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:05.085262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:05.085262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:05.090146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:05.095382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:05.095919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:05.095919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:05.167174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: INFO dbcounter [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] Registered counter for database keystone Sep 19 15:59:05.188722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG oslo_db.sqlalchemy.engines [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:59:05.194928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writer thread running {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:59:05.372019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG passlib.handlers.bcrypt [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81558) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 15:59:05.372406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG passlib.handlers.bcrypt [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81558) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 15:59:05.434764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:05.436340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:05.572281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 15:59:06.048881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:06.118152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: INFO dbcounter [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] Registered counter for database keystone Sep 19 15:59:06.139515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG oslo_db.sqlalchemy.engines [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:59:06.145681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writer thread running {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:59:06.263836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a89ce-1152-4e7b-a65f-d379e43a2a72 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:06.268088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:06.268741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:06.269024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:06.269298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:06.278124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:06.329946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 15:59:06.330240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb9ed9-7807-424a-917e-7a0cf7743d1b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:06.340090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Sep 19 15:59:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 15:59:06.345914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:06.363560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c9250-4bab-4fe7-8f42-9543b98418a7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:06.367900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:06.369655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:06.369928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:06.370205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] PATH_INFO: `/v3/projects/86142456f2d74608ba47355a3c5212f1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:06.371802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] RBAC: Authorizing `identity:get_project(project_id=86142456f2d74608ba47355a3c5212f1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:06.424742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING keystone.common.rbac_enforcer.enforcer [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 15:59:06.425097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552652f6-6444-4f8b-b461-925a6102b490 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:06.429946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Sep 19 15:59:06 2022] GET /identity/v3/projects/86142456f2d74608ba47355a3c5212f1 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:08.557747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b221f-56c6-4cd0-b40f-b59a30f36214 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:08.558302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b221f-56c6-4cd0-b40f-b59a30f36214 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:08.558302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b221f-56c6-4cd0-b40f-b59a30f36214 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:08.562374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:08.567837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:08.568228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:08.568383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:08.588149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:08.589694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:08.597793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 15:59:08.865821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b221f-56c6-4cd0-b40f-b59a30f36214 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:08.878510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b221f-56c6-4cd0-b40f-b59a30f36214 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:08.882678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:08.883279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:08.883555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:08.884401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:08.892054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:08.893825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285985df-0c59-4a1a-92f7-c82be82f7388 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:08.902516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Sep 19 15:59:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:59:08.907796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:08.916666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556618aa-13bd-4e8f-a124-8971860f6630 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:08.920881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:08.921496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:08.921770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:08.922039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:08.923335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:08.925138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3e3f-02d2-4614-bd0c-ec8e575231f4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:08.931456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Sep 19 15:59:08 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:11.123367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407414-60aa-49b4-aac8-e89c5a9433f6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.123905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407414-60aa-49b4-aac8-e89c5a9433f6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.123905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407414-60aa-49b4-aac8-e89c5a9433f6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.125232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:11.130612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.131041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.131137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.149313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:11.150474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:11.154912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449988-c098-4ecb-baf9-cb663e1cf72b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.155197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449988-c098-4ecb-baf9-cb663e1cf72b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.155474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449988-c098-4ecb-baf9-cb663e1cf72b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.156786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:11.161872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.162259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.162558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.205710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG passlib.handlers.bcrypt [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81559) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 15:59:11.206102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG passlib.handlers.bcrypt [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81559) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 15:59:11.231176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:11.254974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:11.256557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:11.357990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:11.504749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.529518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:11.609516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6d722-eace-45c0-9d3b-b327713e9588 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:11.620012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.643452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:11.644107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.644384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.644656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.655981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:11.664758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:11.665823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:11.666829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:11.671556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.724334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8ce4-65a1-45b3-a6c6-efad385a95ee None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:11.726605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:11.753048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:11.766954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:11.768061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.768573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.769079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.772353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0e10-b0bf-47a9-b505-857206ccb233 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:11.807018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:11.807614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.807887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.808153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.808808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:11.809104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:11.810524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:11.822917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:11.828587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.841757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:11.843510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:11.924388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbe19-8ec8-40c5-a5b1-ed9ce759bf4c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:11.941523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 15:59:11.947732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.950711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:11.961287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:11.961946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:11.962225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:11.962509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:11.963649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:11.965105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:11.966694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:11.971977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:11.988106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:12.046336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918583-07d1-4a60-946f-54a30d7dd5d6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:12.073864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b179f-085e-414f-8c45-b18200a26ba3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:12.080919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:12.081767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:12.082048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:12.082316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:12.101525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:12.103549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:12.108803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:12.109418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:12.109695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:12.109960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:12.111072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:12.112488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:12.114002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:12.120492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 15:59:12.122899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:12.124377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 15:59:12.125181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 15:59:12.125181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 15:59:12.125181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:12.125181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:12.129649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:12.185154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:12.202106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:12.221640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c00e4-c311-49db-818f-523ee75e7767 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:12.230820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13960157-5e8a-463d-97a1-31e949de28ae None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:12.255079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:12.255677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:12.255950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:12.256219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:12.256926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.domain.id=default, user.id=00151915182b4e0ba158485ecbf2ff93) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:12.257227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:12.258702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a13ee-fae0-422e-8b74-4c4466091bc3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:12.265022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:12.265142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Sep 19 15:59:12 2022] GET /identity/v3/role_assignments?user.id=00151915182b4e0ba158485ecbf2ff93&scope.domain.id=default&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:12.265628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:12.265901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:12.266209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:12.266823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:12.267119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:12.268498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ebeaf-4ade-46c0-a314-ce84bf997349 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:12.287958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 15:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:15.120410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8afcf-a3cd-46ac-94f8-a3800c5518ef None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.120940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8afcf-a3cd-46ac-94f8-a3800c5518ef None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.121016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8afcf-a3cd-46ac-94f8-a3800c5518ef None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.122293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:15.128026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27542f-7398-4c60-892b-29a7ca5f49fb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.128870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27542f-7398-4c60-892b-29a7ca5f49fb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.129434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27542f-7398-4c60-892b-29a7ca5f49fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.139625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c751-1dba-40d3-8d9a-cda69ebfa1ff None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.140179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c751-1dba-40d3-8d9a-cda69ebfa1ff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.140674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c751-1dba-40d3-8d9a-cda69ebfa1ff None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.142168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:15.147288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc5d3-fcab-426d-852d-3cc4a1e563fe None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.147790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc5d3-fcab-426d-852d-3cc4a1e563fe None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.148253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc5d3-fcab-426d-852d-3cc4a1e563fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.159537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ce27542f-7398-4c60-892b-29a7ca5f49fb None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:15.160852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ce27542f-7398-4c60-892b-29a7ca5f49fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:15.187525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-392dc5d3-fcab-426d-852d-3cc4a1e563fe None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:15.189050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-392dc5d3-fcab-426d-852d-3cc4a1e563fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:15.270406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:15.272770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd64d-38a4-4673-be01-116deb7a803c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.273222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd64d-38a4-4673-be01-116deb7a803c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.273661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefd64d-38a4-4673-be01-116deb7a803c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.275668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 12/25] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:15.276864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72041-ed91-4379-abfd-487e2c9adb5e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.277032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:15.277471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72041-ed91-4379-abfd-487e2c9adb5e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.277959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72041-ed91-4379-abfd-487e2c9adb5e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.279303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:15.283823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.284264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.284650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.290506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.290506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.290506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.312755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:15.314132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:15.316571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:15.317890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:15.364743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:15.393626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:15.460764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 15/29] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:15.619800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:15.653593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:15.664254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:15.730836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac8e5-fa69-4d80-b0c4-80d642dafd23 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:15.769288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:15.770153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.770659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.771104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.772122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:15.773715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:15.860468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea845ca-c220-495e-8660-5306eb8564cf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:15.907073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:15.907919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:15.908346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:15.908752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:15.913588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 15/30] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/roles => generated 219 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:15.915430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:15.921099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:15.922836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 15:59:15.950179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:15.951288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 15:59:15.952274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 15:59:15.952274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 15:59:15.952274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:15.956404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:15.960769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:15.996362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.062235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.110775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e777cd-224c-4fb7-85cd-7f3ebca6532e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.146905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.148275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.148743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.149264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.149945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b1ca-72a6-4376-8bc9-08a7d9f3e328 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.160093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:16.168023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:16.168889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:16.169612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:16.171940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:16.172904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.195369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.196291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.196788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.197252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.198478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.200268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.220123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 16/33] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Sep 19 15:59:15 2022] POST /identity/v3/roles => generated 225 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:16.221105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.293060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93578af-1b5e-4e9f-a441-3de089873ba8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.334516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.344688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.346141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.351409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.351840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.352337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.353616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:16.354016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.355290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84aa78-ff8b-425f-a788-fa67d00e198a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.355769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067147-6d71-4e6c-b365-5cc38ee6bbd3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.382529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 18/34] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 15:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:16.384936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d792a-dd5a-42bd-aa6f-13fc3031aa4d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.385371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d792a-dd5a-42bd-aa6f-13fc3031aa4d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.385742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d792a-dd5a-42bd-aa6f-13fc3031aa4d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.387497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 19/35] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:16.388455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d792a-dd5a-42bd-aa6f-13fc3031aa4d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.398161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073713-c031-4798-b469-d09fd835559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.399800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073713-c031-4798-b469-d09fd835559b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.400321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073713-c031-4798-b469-d09fd835559b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.400827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073713-c031-4798-b469-d09fd835559b None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.401713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073713-c031-4798-b469-d09fd835559b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:16.403328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073713-c031-4798-b469-d09fd835559b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.405055 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073713-c031-4798-b469-d09fd835559b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.420410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 17/36] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:16.422181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.422700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.423229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.444903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:16.446953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:16.513451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d792a-dd5a-42bd-aa6f-13fc3031aa4d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.529090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 18/37] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:16.530028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.553914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.554682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.555093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.555398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.556211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.558566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20839-ba89-4efd-8b92-a988d476c201 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.632342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.647341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ebfd8-9bcc-4374-91e4-9c7f90722bbf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.694733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.695303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.695583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.695861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.697985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.699513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.701181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:16 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:16.706965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.736569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 15:59:16 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:16.812415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9008a-d5e5-4e21-bdf1-486a399b8296 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.812729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9008a-d5e5-4e21-bdf1-486a399b8296 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.812978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9008a-d5e5-4e21-bdf1-486a399b8296 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.814406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 21/40] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:16.821098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9008a-d5e5-4e21-bdf1-486a399b8296 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.825910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37152083-8444-421d-b30f-e7c2bddff4f6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.851692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.863902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.864544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.864824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.865096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.866255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:16.867775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e6cc7-d317-46db-80ef-c9efd0313be3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:16.874563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 20/41] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:16.874563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.874563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:16.874563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:16.891181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:16.892417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:16.911979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:16.956062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9008a-d5e5-4e21-bdf1-486a399b8296 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:16.973971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:16.974672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:16.999142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:16.999661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:16.999962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:17.000236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:17.001422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:17.003271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:17.005000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:17.010214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:17.087747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3e53-c5d4-4945-ad89-56048adb2986 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:17.125095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:17.125767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:17.126044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:17.126319 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] PATH_INFO: `/v3/domains/default/users/00151915182b4e0ba158485ecbf2ff93/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:17.128265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=00151915182b4e0ba158485ecbf2ff93, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:17.129705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:17.145178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 22/44] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Sep 19 15:59:16 2022] PUT /identity/v3/domains/default/users/00151915182b4e0ba158485ecbf2ff93/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:17.225064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:17.233746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9377ed0-2f5b-4bcd-82c5-65564f424b40 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:17.238997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:17.256804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:17.274902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:17.275530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:17.275926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:17.276201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:17.276873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:17.278406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a33f67-9b97-487b-a851-9ac2a49a4656 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:17.314880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 15:59:17 2022] POST /identity/v3/projects => generated 312 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:59:17.367598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a113b-07b2-451f-b5b6-4995bfafad99 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:17.405838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:17.406455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:17.406760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:17.407031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:17.407707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:17.409128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fe3a8-0cb3-4b4d-b326-ee7ca320964d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:17.425416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Sep 19 15:59:17 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:59:19.292029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ede9e1-1ab7-449a-a7b5-64a9ecf8b0c7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.292570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ede9e1-1ab7-449a-a7b5-64a9ecf8b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.292570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ede9e1-1ab7-449a-a7b5-64a9ecf8b0c7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.293937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:19.299093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3140-9c79-4ae2-b91c-35109ea4a9fa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.299476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3140-9c79-4ae2-b91c-35109ea4a9fa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.299649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3140-9c79-4ae2-b91c-35109ea4a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.318202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-975b3140-9c79-4ae2-b91c-35109ea4a9fa None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:19.319427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-975b3140-9c79-4ae2-b91c-35109ea4a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:19.392506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:19.480122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500416e-a2db-47a8-8fca-153bd8e3a24b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.480403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500416e-a2db-47a8-8fca-153bd8e3a24b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.480675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500416e-a2db-47a8-8fca-153bd8e3a24b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.481988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 25/49] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:19.487171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.487459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.487729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.496101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:19.506719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:19.507879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:19.572675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 25/50] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:19.662882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500416e-a2db-47a8-8fca-153bd8e3a24b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:19.761755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500416e-a2db-47a8-8fca-153bd8e3a24b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:19.794218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:19.794863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.795145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.795421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.805921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:19.810883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:19.811836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:19.812580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 26/51] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:19.817633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:19.834516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:19.845362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:19.916847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7640-ce98-462a-bd30-851891b44336 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:19.933594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9796-cec2-4524-ae28-fe2b3599dd6f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:19.950439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:19.951069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.951350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.951619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.952266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:19.952568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:19.953947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:19.955260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:19.963003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:19.966958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:19.967841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:19.968119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:19.968389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:19.968476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:19.969488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:19.970976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:19.972504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:19.978275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:20.061792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:20.086205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86b064-38f4-4133-9489-1da573a5b5e4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:20.119861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:20.120572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:20.120861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:20.121133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:20.121774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:20.123290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:20.149764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 28/54] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Sep 19 15:59:19 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:59:20.174385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e4a6-ef8d-4f71-9196-3eb960c72a44 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:20.210346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:20.211010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:20.211287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:20.211558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:20.213256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:20.214737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:20.216360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:19 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:20.222188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:20.328566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d25b0-29cb-407c-a051-7366e51de280 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:20.358245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:20.367127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:20.367766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:20.368043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:20.368312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:20.369396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:20.370926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c885e1-e327-46cd-a672-a2d28587243b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:20.372477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:20.378368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:20.439673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:20.478215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc087e-70f9-4e69-8d23-190c8c36e59a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:20.516224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:20.516907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:20.517190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:20.517466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:20.518196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.domain.id=default, user.id=00151915182b4e0ba158485ecbf2ff93) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:20.518526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:20.519972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f084a3-729a-4a38-a080-95d059a873fa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:20.529395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Sep 19 15:59:20 2022] GET /identity/v3/role_assignments?user.id=00151915182b4e0ba158485ecbf2ff93&scope.domain.id=default&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:22.318037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618656bf-68a8-43c6-9e45-d61169e2335e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:22.318575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618656bf-68a8-43c6-9e45-d61169e2335e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:22.318664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618656bf-68a8-43c6-9e45-d61169e2335e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:22.319937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:22.325527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:22.325957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:22.326064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:22.343806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:22.344989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:22.409196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:22.675915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618656bf-68a8-43c6-9e45-d61169e2335e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:22.773409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618656bf-68a8-43c6-9e45-d61169e2335e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:22.805856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:22.806460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:22.806767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:22.807037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:22.808140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:22.809577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad61c6-a1d2-4e23-86b7-e6959f8a092c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:22.811129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:22.816456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:22.873033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:22.914364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b454-c34e-4327-b058-e13d83b42d9c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:22.948170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:22.948707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:22.948986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:22.949259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:22.949916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:22.951397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49175cc-405c-4de2-86ef-89b1dfbfbd4a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:22.978594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:22 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:26.212235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6f30-d122-42bf-b24d-68471186b734 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.213208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6f30-d122-42bf-b24d-68471186b734 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.213768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6f30-d122-42bf-b24d-68471186b734 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.215400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:26.220804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca36-b05d-414b-b904-7bf0e18b223e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.221631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca36-b05d-414b-b904-7bf0e18b223e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.222102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca36-b05d-414b-b904-7bf0e18b223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.247371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-092eca36-b05d-414b-b904-7bf0e18b223e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:26.248926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-092eca36-b05d-414b-b904-7bf0e18b223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:26.338874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:26.501083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0632-964a-4d0d-8d79-fc5fb674cee4 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.501727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0632-964a-4d0d-8d79-fc5fb674cee4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.502233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0632-964a-4d0d-8d79-fc5fb674cee4 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.503884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 33/64] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:26.510174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e4ea-4139-4264-b095-4a899e30abad None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.510760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e4ea-4139-4264-b095-4a899e30abad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.511225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e4ea-4139-4264-b095-4a899e30abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.535353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-72a7e4ea-4139-4264-b095-4a899e30abad None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:26.536952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-72a7e4ea-4139-4264-b095-4a899e30abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:26.583778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:26.613782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:26.677766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba756af-6a5a-41d2-afec-c9d7fa34029b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.678369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba756af-6a5a-41d2-afec-c9d7fa34029b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.678887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba756af-6a5a-41d2-afec-c9d7fa34029b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.680564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 34/66] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:26.686027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619d-bc78-4cb5-aa18-d00fa7c2749f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.686595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619d-bc78-4cb5-aa18-d00fa7c2749f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.687073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619d-bc78-4cb5-aa18-d00fa7c2749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.719651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d1f4619d-bc78-4cb5-aa18-d00fa7c2749f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:26.721184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d1f4619d-bc78-4cb5-aa18-d00fa7c2749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:26.734377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba756af-6a5a-41d2-afec-c9d7fa34029b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:26.809193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:26.820642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:26.822380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a312-ad11-4a18-a5a5-50f40879e0be None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.823362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a312-ad11-4a18-a5a5-50f40879e0be None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.823869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a312-ad11-4a18-a5a5-50f40879e0be None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.825712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 34/68] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:26.831859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.832138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.832407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.852138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:26.854051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:26.870394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba756af-6a5a-41d2-afec-c9d7fa34029b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:26.937996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:26.938922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:26.939375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:26.941245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:26.960354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:26.964848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 35/69] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:26.965909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:26.972507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:26.973364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:26.974098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 35/70] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:26.979919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.005132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.085732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270646c-a2aa-4ac1-a1e3-273b3dbc22bb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.121563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.122221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.122512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.122804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.135046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-8d5d7f61-14cb-434e-bd0e-405fc45dcc78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:27.141747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:27.142618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:27.143384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:27.143951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce285f-4c4e-41cd-bccd-35319aab71e0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.144019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:27.144357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbbd3-cc5f-4b87-86cc-7509b5ef9d59 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.144629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbbd3-cc5f-4b87-86cc-7509b5ef9d59 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.144874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfbbd3-cc5f-4b87-86cc-7509b5ef9d59 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.146089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 37/72] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:27.146796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfbbd3-cc5f-4b87-86cc-7509b5ef9d59 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.171707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.183688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.184296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.184572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.184840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.185657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:27.185958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.187974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.197062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:27.197684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.250140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.260093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfbbd3-cc5f-4b87-86cc-7509b5ef9d59 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.300848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.301472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.302005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.302272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.305545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d45d0-b5dd-4dd4-be0f-990c5e3ce290 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.313954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-76a1499b-cb48-4805-9500-87683303f7e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:27.320042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:27.321371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:27.322176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 38/74] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:27.322826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.323128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.323359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.341629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:27.341787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.342166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.342445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.342748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.342878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:27.343434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:27.343733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.345098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.353359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:27.353985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.402783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.417034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:27.417878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.459050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663784f-3486-48e2-ad79-8a435a349737 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.497120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.497748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.498026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.498301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.507936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.513049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.514533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.516441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:27.516913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.531980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bccd7-28fc-40cc-98e4-b296b799c993 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.569493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.570125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.570402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.570699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.581697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:27.586546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:27.587556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:27.588315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 40/78] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:27.589576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.627265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7467-e217-4219-a3d1-d07eadc780be None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.635121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.663577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.664187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.664593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.664763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.665419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:27.665719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.667222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.680729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 39/79] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:27.680729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.705943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed397-1d68-4a54-b004-2b3b00cbcfe3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.739710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.740332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.740608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.740878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.741993 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.744001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.745561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:27.746304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.762790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.777195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729769c7-db43-45e5-ae23-de0c07340210 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.811150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.811747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.812020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.812293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.845522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.848251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412ee4-61d0-400e-9276-8215393007e0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:27.880069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.881494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.882430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:27.883360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:27.883638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:27.883916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:27.884559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:27.884853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:27.886208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:27.894266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:27.895097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.971142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:27.978750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:27.979586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:27.996125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400775b8-f26a-41b9-be45-c64a3c2d30a8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.028656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.029275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.029551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.029821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.030940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.032387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.033935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 43/83] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:28.034706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.050582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.084924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64030a65-9751-4478-b3c7-c23ea889b63d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.119332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.119951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.120228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.120496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.121607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.123099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.124636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 41/84] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:28.125383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.134540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb407c-c993-48fa-9ff7-360b754e56a1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.167949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.168546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.168828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.169098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.181109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.223247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0a98-39c0-4571-940d-b286b30735a9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.237072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.238581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.256835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.257451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.257727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.257998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.259296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.260724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.262278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 42/85] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:28.263066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.267208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.341025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:28.341662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.364729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf677-16fb-40ab-b612-4faf0aa036fb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.385761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.398293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.399451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.399720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.399988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.401099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.402581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.404187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 43/87] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:28.405012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.448192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9347c-6a5f-4a7f-8b98-9eac8c20b718 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.471027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.481520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.482132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.482409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.482705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.499529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32fe5-c415-4681-b971-06ba96011b8e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.532073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.532662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.532936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.533205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.533873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.535741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.549317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.550779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.562676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 44/88] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:28 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:28.563481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.607051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.669747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 45/89] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:28.670875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.702818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d600-9abb-4f06-930f-8258f03d9c86 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.732570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.744456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.745072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.745345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.745976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.792032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0164a-d969-4f13-9ad9-33ad87fb43d4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:28.831129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.832605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.837708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:28.838345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:28.838694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:28.838967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:28.840105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:28.841565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:28.843488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:28.847471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.862012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.956226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 45/91] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:28.956823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:28.986261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:28.992052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db763b-8826-4f7a-a377-21ea8b05ef23 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.029898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.030625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.030970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.031310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.032100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:29.032477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.034052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.040563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 47/92] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a91a89818523427f9295a540fa435066 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:29.041481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:29.083491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cc19-6feb-4164-8193-6af1f6f9d3a5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.124651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:29.125493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.126294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.126644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.127008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.128470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.130743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.132656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:28 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:29.133461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:29.153752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75fe6d-9728-4d6d-9f08-21773716aebf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.190963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9227-3efb-4031-86ce-448700027950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.191697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9227-3efb-4031-86ce-448700027950 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.192044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9227-3efb-4031-86ce-448700027950 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.192383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9227-3efb-4031-86ce-448700027950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.193196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9227-3efb-4031-86ce-448700027950 None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:29.193574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9227-3efb-4031-86ce-448700027950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.195218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9227-3efb-4031-86ce-448700027950 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.202863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:29 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:29.203809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9227-3efb-4031-86ce-448700027950 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:29.283571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbf410-8a85-4c8b-9b48-4b391c3e9fe8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.286808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:29.328497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9227-3efb-4031-86ce-448700027950 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.360751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.361428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.361709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.361986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] PATH_INFO: `/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.363300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] RBAC: Authorizing `identity:get_project(project_id=664d4ec0ca3642b4a61f49a61be6b8ba)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.364929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.366947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:29 2022] GET /identity/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:29.372897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:29.387716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.388769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.389075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.389351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.390443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=00151915182b4e0ba158485ecbf2ff93) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:29.390781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.392346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e46e7c-04ea-4cb7-8cd3-6582f5f22cca None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.400681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:29 2022] GET /identity/v3/role_assignments?user.id=00151915182b4e0ba158485ecbf2ff93&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:29.504846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eef8d-b308-478e-8fa6-1e42c2ede637 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:29.550353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:29.550936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:29.551216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:29.551490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:29.552512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=664d4ec0ca3642b4a61f49a61be6b8ba, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:29.552826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:29.554344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7c7f-5893-409a-9637-d80e18c458bd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:29.566656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:29 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=664d4ec0ca3642b4a61f49a61be6b8ba&role.id=a91a89818523427f9295a540fa435066 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:31.366080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901eb25-4ee6-4541-96a8-cfb510ac2ef8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:31.366595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901eb25-4ee6-4541-96a8-cfb510ac2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:31.366674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901eb25-4ee6-4541-96a8-cfb510ac2ef8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:31.368200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:31.384288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637805b-71cc-4b4d-9683-41c7b94a7931 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:31.384781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637805b-71cc-4b4d-9683-41c7b94a7931 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:31.384851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637805b-71cc-4b4d-9683-41c7b94a7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:31.408587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d637805b-71cc-4b4d-9683-41c7b94a7931 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:31.410174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d637805b-71cc-4b4d-9683-41c7b94a7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:31.439472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:31.490587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:32.042521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901eb25-4ee6-4541-96a8-cfb510ac2ef8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.045735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:32.056030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47416d-431f-407a-9b32-1c7d67c9ffe5 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.056343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47416d-431f-407a-9b32-1c7d67c9ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.056575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47416d-431f-407a-9b32-1c7d67c9ffe5 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.057973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 50/100] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:32.068030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66a78-66f0-4a7d-9e02-24bf50b9fd98 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.068358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66a78-66f0-4a7d-9e02-24bf50b9fd98 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.068583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66a78-66f0-4a7d-9e02-24bf50b9fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.107836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c4b66a78-66f0-4a7d-9e02-24bf50b9fd98 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:32.109199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c4b66a78-66f0-4a7d-9e02-24bf50b9fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:32.223443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 51/101] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:32.225083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901eb25-4ee6-4541-96a8-cfb510ac2ef8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:32.225482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc954-a099-459c-8ca0-cfbb5cf41be3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.226253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc954-a099-459c-8ca0-cfbb5cf41be3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.226987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc954-a099-459c-8ca0-cfbb5cf41be3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.229975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 52/102] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:32.235981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716abb-1b38-4cda-b263-50c3efed1462 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.236507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716abb-1b38-4cda-b263-50c3efed1462 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.237455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716abb-1b38-4cda-b263-50c3efed1462 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.239388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 53/103] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:32.240749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.241248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.241718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.272894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:32.275394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:32.278838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:32.279477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.279749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.280019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.298956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-cedf3682-a5e1-4dc3-a837-5c7125022ff3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:32.306940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:32.307771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:32.308526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:32.311613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 51/104] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:32.312794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.313072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.313341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.354420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:32.357668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:32.409805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 54/105] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:32.410699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.454886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:32.473445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:32.503773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:32.574060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56021d5-1e61-4741-ac23-d672e9a67564 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:32.619625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:32.620329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.620612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.620885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.621638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:32.621940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:32.623461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:32.638975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 55/107] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:32.644907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.691017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.816684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:32.823417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2af006-ad78-469d-a018-99543c34afa7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:32.837329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda97ca0-704d-45c3-80f0-e1ba42b8ad15 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:32.872495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:32.873136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.873416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.873691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.884702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:32.890088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6d29af52-9b84-4635-ad39-9728b2687e8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:32.890357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:32.891416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:32.892306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:32.893078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.893078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.893078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] PATH_INFO: `/v3/users/dc364178342443d1844f0d4c1d78a491` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.894508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 56/108] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:32.895886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054c21-f06b-49f8-988d-de3cf8ca1ae8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:32.896308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054c21-f06b-49f8-988d-de3cf8ca1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:32.896722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1054c21-f06b-49f8-988d-de3cf8ca1ae8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:32.898104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 57/109] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:32.903048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1054c21-f06b-49f8-988d-de3cf8ca1ae8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.912274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] RBAC: Authorizing `identity:get_user(user_id=dc364178342443d1844f0d4c1d78a491)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:32.913939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:32.915980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 53/110] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/users/dc364178342443d1844f0d4c1d78a491 => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:32.916579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:32.985757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.022717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1054c21-f06b-49f8-988d-de3cf8ca1ae8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.041970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715cbdd-ba75-4b18-bb43-470f0eb320d9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.059833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.060671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.060954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.061229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.062501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.064015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d597ad3-b3ad-4add-939f-7d55101c3a07 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.070515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:33.070515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.070515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.070515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.087285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:33.087538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.088105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.088462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.088569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:33.088796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.089532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:33.089901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.091051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.091515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.101890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 54/112] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:33.107397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.163873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 59/113] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:33.165163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.224862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eeb577-c417-4570-82df-dfa18151b63a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.238804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.261290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.261906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.262205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.262468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.280234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee432cf-51ce-4ae1-93f5-b56fd99d684a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.319225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.319851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.320127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.320394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.329258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.331736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:33.337125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:33.338022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:33.339559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 60/114] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:33.340179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.340247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.340819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.446083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 55/115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:33.447085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5187e-ea7b-4b4a-8143-2d897ff1d365 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.447566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.462451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.482933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.483539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.483826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.484094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.484732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.486193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcd520-1a2e-49fe-9021-10368d906947 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.512269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 61/116] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 15:59:33 2022] POST /identity/v3/projects => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:33.513575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83717a-d78c-480c-9f73-70bbd13e22d7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.513866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83717a-d78c-480c-9f73-70bbd13e22d7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.514143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83717a-d78c-480c-9f73-70bbd13e22d7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.518545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 62/117] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:33.518545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83717a-d78c-480c-9f73-70bbd13e22d7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.561202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae2a1-703e-431a-ad83-cd3f8428a2be None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.581081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.603227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.603813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.604094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.604369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.605598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.607169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.609051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 56/118] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:33.614300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.646277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83717a-d78c-480c-9f73-70bbd13e22d7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.686389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.687280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.687568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.687850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.688527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:33.688834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.690266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.701642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 63/119] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:33.703031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.710829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.740452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c640-a793-478e-a33f-a01f61cacb31 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.778914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.779658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.780100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.780440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.792134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2ba822ca-1256-4704-b196-2466c323a974 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:33.797006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:33.797843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 57/120] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:33.803166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.803856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.803856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.816042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c14dd-6e9f-46c4-aa3a-953adb5db56f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:33.818578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:33.819779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:33.829891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:33.855262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:33.856226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:33.856699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:33.857176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:33.858469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:33.860124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:33.861754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 64/121] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:33.863415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.895373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 58/122] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:33.897235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:33.968409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.001237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413978fc-1281-4f8b-a3ce-09276aae713f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.004240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378102b-852c-4714-b540-ae3d9d177682 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.037539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.038196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.038602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.038881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.040125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.041573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.043629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 59/123] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.044199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.050307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.051270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.052396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.052888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.054782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.057165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.059537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 65/124] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:33 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.064644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.127300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.155004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94145c7-9b82-481e-ac43-8d414105c717 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.190312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27067374-0422-4ab3-9518-af267629974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.190938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067374-0422-4ab3-9518-af267629974b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.191212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067374-0422-4ab3-9518-af267629974b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.191481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27067374-0422-4ab3-9518-af267629974b None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.192140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27067374-0422-4ab3-9518-af267629974b None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:34.192448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27067374-0422-4ab3-9518-af267629974b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.194046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27067374-0422-4ab3-9518-af267629974b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.198967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac91e50-49eb-45c8-b000-4c715cf6918c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.200593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.205794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 60/125] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.207001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27067374-0422-4ab3-9518-af267629974b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.245111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.245716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.246011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.246275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.247032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=dc364178342443d1844f0d4c1d78a491) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:34.247338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.248796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.254392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 66/126] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/role_assignments?user.id=dc364178342443d1844f0d4c1d78a491&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.255210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.333911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27067374-0422-4ab3-9518-af267629974b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.381306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.382371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.382881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.383942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.385504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.387151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.393568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 61/127] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.393568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.407604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fdbec-3d54-48cd-aee3-324854a1bfe7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.427945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.459111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.460464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.460739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.461013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.465909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, user_id=2752d28631c647fcb7a8953e5c6ff7d2, role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.467483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.478864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.494514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 67/128] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:34 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:34.494514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.562170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac62c-82db-43ca-9fad-3f8d4199863a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.626426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.627124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.627411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.627654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.630955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.632507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.643343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 62/129] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:34.644328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.719711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a34f-a5b7-463a-a0eb-c473d3a2bb38 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.764744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.765395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.765701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.765977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.791047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:34.794928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b5438-b2de-4798-9ae3-35be5cf0466e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:34.801578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:34.807872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 68/130] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:34.808621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:34.869398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:34.871540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:34.872164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:34.873186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/00151915182b4e0ba158485ecbf2ff93/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:34.874526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.876765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, user_id=00151915182b4e0ba158485ecbf2ff93, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:34.880695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:34.891633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:34.910253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 63/131] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:34 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/00151915182b4e0ba158485ecbf2ff93/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:34.911757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:35.049562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3352fa-0355-4bdb-98e0-2bdde6578803 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.069542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3322e-6eb8-43e0-bcd0-08c8949f19ff None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.121922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.122627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.122913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.123190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.123938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:35.124403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.126067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.127185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.128182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.128465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.129277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.134018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.136044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.136728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:35.139438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:34 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:35.142532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:35.146107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:35.282323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:35.362515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbbab-bfc4-4e51-8d9d-05ee15b7886f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.393230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:35.399011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067517f0-8e51-428b-87a6-bea8dc638f53 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.413000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.413720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.414005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.414281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.418278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.421412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.423067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 65/134] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:35 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:35.429406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:35.471427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.472105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.472387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.472664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.478758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, user_id=2752d28631c647fcb7a8953e5c6ff7d2, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.478758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.502160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 70/135] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:35 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:35.581458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6e973-6e42-433d-896b-8dbf62b279af None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.609787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:35.620856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.621510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.621791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.622064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] PATH_INFO: `/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.623310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] RBAC: Authorizing `identity:get_project(project_id=664d4ec0ca3642b4a61f49a61be6b8ba)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.624831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f410d-cde6-4855-bd43-8d1d1bf2a0fa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.626697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 66/136] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:35 2022] GET /identity/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:35.634368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:35.776919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379569e-4d64-420c-a3b4-5856f7b03b04 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:35.813592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:35.814629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:35.815101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:35.815564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] PATH_INFO: `/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:35.817794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] RBAC: Authorizing `identity:create_grant(project_id=664d4ec0ca3642b4a61f49a61be6b8ba, user_id=2752d28631c647fcb7a8953e5c6ff7d2, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:35.819602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecab85-e7d5-4075-88d5-4a4c2647015d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:35.834108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 71/137] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:35 2022] PUT /identity/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba/users/2752d28631c647fcb7a8953e5c6ff7d2/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:36.310662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899533d2-fa3a-4d7e-85d6-0d07934ab696 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:36.311045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899533d2-fa3a-4d7e-85d6-0d07934ab696 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:36.311219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899533d2-fa3a-4d7e-85d6-0d07934ab696 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:36.312680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 67/138] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:36.324317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5466e-03a0-4080-99db-1df93721b8d3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:36.324896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5466e-03a0-4080-99db-1df93721b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:36.325362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5466e-03a0-4080-99db-1df93721b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:36.353330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ffa5466e-03a0-4080-99db-1df93721b8d3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:36.354907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ffa5466e-03a0-4080-99db-1df93721b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:36.374130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:36.451199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:36.959393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaa14-7f39-4a5f-b7f3-16ca1cb71a6c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:36.960370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaa14-7f39-4a5f-b7f3-16ca1cb71a6c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:36.960849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaa14-7f39-4a5f-b7f3-16ca1cb71a6c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:36.962791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 68/140] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:36.967890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:36.968296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:36.968446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:36.990783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdaa14-7f39-4a5f-b7f3-16ca1cb71a6c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:36.996251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:36.996251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:37.087820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 73/141] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:37.143208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdaa14-7f39-4a5f-b7f3-16ca1cb71a6c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:37.195362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:37.196210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:37.196486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:37.196760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:37.200041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:37.201501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:37.203289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 69/142] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:37.208590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:37.316696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:37.339935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6c06-94c2-419d-ac95-a61b2269bc12 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:37.383137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:37.383137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:37.383137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:37.383137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:37.387583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:37.387583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50e8f2-1fd7-4dd8-bd09-208d3029fd1e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:37.421090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 74/143] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:37 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:37.667460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:37.679995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec09f8-6d83-4453-a23d-05824745fd98 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:37.680361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec09f8-6d83-4453-a23d-05824745fd98 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:37.680564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec09f8-6d83-4453-a23d-05824745fd98 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:37.682028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 75/144] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:37.690762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:37.691041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:37.691300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:37.719088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:37.720288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:37.782662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:37.847273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 76/145] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:37.849100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc9897-649a-48b8-9cd2-cc1e5d06120f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:37.916140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:37.916799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:37.917078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:37.917353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:37.938354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:37.944446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:37.945263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:37.946702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:37.949207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 70/146] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:37.954736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.045303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:38.093180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b059e7-d667-4bd3-8614-f7b6e0cc78b9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.144996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.145603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.145878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.146148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.146836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:38.147135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:38.148513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:38.158029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 77/147] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:38.163340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.196354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.329866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07ca1-9a16-46bd-bbb0-1e5971cd7250 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.374268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266603-57b5-4149-972e-9545aad08761 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.378309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:38.397940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.399220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.399703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.400158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] PATH_INFO: `/v3/users/dc364178342443d1844f0d4c1d78a491` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.403670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] RBAC: Authorizing `identity:get_user(user_id=dc364178342443d1844f0d4c1d78a491)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:38.405779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:38.407593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 71/148] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:38 2022] GET /identity/v3/users/dc364178342443d1844f0d4c1d78a491 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:38.416647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:38.426398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.436515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.437169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.437439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.441120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.464865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-8bb35f05-7f8e-44d9-adaa-4d4847818ecc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:38.470580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:38.471523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:38.472309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 78/149] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:38.473474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53bed-606b-46b8-9de7-7a6d7adf4f97 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.473575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53bed-606b-46b8-9de7-7a6d7adf4f97 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.473848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53bed-606b-46b8-9de7-7a6d7adf4f97 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.479778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 79/150] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:38.481308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad53bed-606b-46b8-9de7-7a6d7adf4f97 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.558757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434dc0-fe47-4268-aa66-980d145c4741 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.592967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.593596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.593870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.594141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.595307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:38.596799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c250862-0b6f-44d0-bbf3-5f272241caa9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:38.598564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 72/151] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:38 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:38.599747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43893f-e1af-4103-a680-08d9bb2e71ec None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.600025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43893f-e1af-4103-a680-08d9bb2e71ec None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.600293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43893f-e1af-4103-a680-08d9bb2e71ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.624115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ef43893f-e1af-4103-a680-08d9bb2e71ec None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:38.625302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ef43893f-e1af-4103-a680-08d9bb2e71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:38.632222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad53bed-606b-46b8-9de7-7a6d7adf4f97 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.672551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.673225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.673494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.673764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.674591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:38.674893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:38.676458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:38.685034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:38.694957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 80/152] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:38.696727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.706532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 73/153] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:38.707806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983293a-1aa5-4966-913c-f179be2fe24e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.708080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983293a-1aa5-4966-913c-f179be2fe24e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.708344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983293a-1aa5-4966-913c-f179be2fe24e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.709582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 74/154] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:38.710258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983293a-1aa5-4966-913c-f179be2fe24e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:38.803408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:38.884347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983293a-1aa5-4966-913c-f179be2fe24e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.922000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:38.922688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.922962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.923226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.924523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:38.925316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4db89-e4e4-4aaa-967a-e629da83e093 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:38.925967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935037fa-eb87-4112-9f3a-8e15e4d092dd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:38.928852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 75/155] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:38 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:38.928969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:38.929242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:38.929513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:38.948586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:38.949757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:39.026897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.030986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 76/156] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:39.031936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.039251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.040721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.041148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.041559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/dc364178342443d1844f0d4c1d78a491/roles/a136b0fbdd82447faf4932746f2c04f8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.047379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, user_id=dc364178342443d1844f0d4c1d78a491, role_id=a136b0fbdd82447faf4932746f2c04f8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:39.049550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:39.080794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 81/157] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:38 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/users/dc364178342443d1844f0d4c1d78a491/roles/a136b0fbdd82447faf4932746f2c04f8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:39.089074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.162573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813704fe-b104-448c-8b2c-ecc80de11918 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.207951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.209230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.209664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.210080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.281626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.300007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:39.305899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7956-6454-4cea-8253-81ce132ab555 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:39.364017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b8f7-7ec3-47e7-9319-6f079c740041 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.388550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.436319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.436970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.437243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.437561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.451109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c029774a-6072-49e1-aa52-fc450015a9fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:39.456763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:39.457716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:39.458468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 82/158] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:39.459214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3db0-af8e-439f-b39e-717a0758de6f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.460013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3db0-af8e-439f-b39e-717a0758de6f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.460013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3db0-af8e-439f-b39e-717a0758de6f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.461767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 83/159] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:39.466296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3db0-af8e-439f-b39e-717a0758de6f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.480855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 77/160] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:39.482125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.482410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.482713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.512843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:39.514038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:39.610342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3db0-af8e-439f-b39e-717a0758de6f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.621166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 78/161] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:39.621870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.650432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.671826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.672448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.672720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.673053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.673777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:39.674077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:39.675526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:39.688830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 84/162] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:39.689698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.737011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.792943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e65ef-63c4-4a5c-8abb-545aea671544 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.851222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.851872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.852676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.852948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.854155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:39.855656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:39.857309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 79/163] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:39.858074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:39.877826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607e7-8025-422b-9d5c-f1cf6c56a270 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.951008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:39.952064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:39.952546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:39.953069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:39.965804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:39.976551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:39.982720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d62d01-aaf4-4cc4-ad11-c05626f17494 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:39.983227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:39.984057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:39.984808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:39.987170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 85/164] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:39.994561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.024296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.024930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.025279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.025489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] PATH_INFO: `/v3/users/00151915182b4e0ba158485ecbf2ff93` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.026731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] RBAC: Authorizing `identity:get_user(user_id=00151915182b4e0ba158485ecbf2ff93)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:40.028112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:40.029882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 80/165] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/users/00151915182b4e0ba158485ecbf2ff93 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:40.030496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.135609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fdffd-2c71-482e-bd91-b974b4d041ef None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.162543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:40.172315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.173054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.173433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.173808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.174601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:40.175001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:40.176591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:40.177358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dcc3a-a5e5-4950-97c0-06c754361d2b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.188320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 81/166] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:40.194507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.211965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:40.245160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.246087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.246534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.246963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.247890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:40.248482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:40.250212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:40.263660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 86/167] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:39 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:40.264742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.307501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186fbf-be26-463e-9893-1fdab73e1b76 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.378324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.378974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.379246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.379512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.503070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae351275-4f3f-4915-b1dc-ef210c925caa None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.530432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:40.531943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:40.565018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:40.574924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.575586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.575864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.576139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.583419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:40.584935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:40.586728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 87/168] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:40.587593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.628441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:40.740128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 82/169] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:40.740810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.770056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a6f0-33b8-47b8-8494-8f953306d94f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.809249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:40.809875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:40.810147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:40.810411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:40.822810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:40.828053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:40.828917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:40.829695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 88/170] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:40.831109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:40.953734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cefdd-59df-48bd-9e26-b2a1b3c6a49c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:40.972048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:40.989563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:41.006102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.006777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.007050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.008079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.028176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccc22-7625-466b-92b1-2a45de2cf6f0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.123215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.123864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.124141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.124420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.125600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.126542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.127091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.127997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.128872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 89/171] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.129549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.292548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c555f-e2e1-42f8-a4da-07a889f468e8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.335376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 83/172] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:41.336160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.354566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.354566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.354816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.356097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.356097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:41.356097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.357390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.370582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 90/173] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.371495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.398931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:41.399748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:41.468879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a49f8-8b26-4cd4-ad85-80ec129450dc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.513140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.513875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.514158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.514425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.515182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=00151915182b4e0ba158485ecbf2ff93) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:41.515489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.516941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.535765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 84/174] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/role_assignments?user.id=00151915182b4e0ba158485ecbf2ff93&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.539908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.566548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61f94-abc9-486b-a779-04ea5c9cb1b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.655848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.656510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.656783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.657049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.658209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.659744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.661424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 91/175] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.671548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.704378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:41.734739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8541-fb5f-4b90-832e-d762936bc08c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.795909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.796561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.796841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.797114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] PATH_INFO: `/v3/users/2752d28631c647fcb7a8953e5c6ff7d2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.799387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] RBAC: Authorizing `identity:get_user(user_id=2752d28631c647fcb7a8953e5c6ff7d2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.800868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.802790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 85/176] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/users/2752d28631c647fcb7a8953e5c6ff7d2 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.830152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:41.830780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:41.859373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300045-561e-491a-b0c4-0719ff20b6ba None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.958281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907cb-af22-4497-ac79-b476afbe2e0e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:41.963188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:41.963820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.964101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.964373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.965110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:41.965420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:41.966920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0770b-63a6-4fde-929b-4057e5361a51 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:41.984772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 92/177] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a91a89818523427f9295a540fa435066 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:41.986091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813c8de-bed4-42f8-9a04-0f30f8f01cf9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:41.986378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813c8de-bed4-42f8-9a04-0f30f8f01cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:41.986671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813c8de-bed4-42f8-9a04-0f30f8f01cf9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:41.987879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 93/178] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:41.999998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.000302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.000606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.001340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:42.001969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.002300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.002652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.020870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:42.043601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:42.044830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:42.081196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:42.082639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:42.193907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 86/179] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:42.200396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:42.219830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 94/180] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:42.275627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:42.339605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e865bb5-0186-49bb-bc9e-ce8eb3f04360 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:42.393582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:42.394225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.394521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.395097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] PATH_INFO: `/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.395954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] RBAC: Authorizing `identity:get_project(project_id=664d4ec0ca3642b4a61f49a61be6b8ba)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:42.397425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b32a-e2d3-4bbe-9528-4f2c5a9b5b3f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:42.399974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 87/181] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:42 2022] GET /identity/v3/projects/664d4ec0ca3642b4a61f49a61be6b8ba => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:42.406106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:42.490464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:42.515839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5cd84-380e-4542-b046-3c904c2aa580 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:42.556562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:42.557217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.557496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.557767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.558530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=664d4ec0ca3642b4a61f49a61be6b8ba, user.id=2752d28631c647fcb7a8953e5c6ff7d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:42.558818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:42.560309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04240b3f-c3cb-43bc-8a23-5412b49f050d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:42.571445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 95/182] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:42 2022] GET /identity/v3/role_assignments?user.id=2752d28631c647fcb7a8953e5c6ff7d2&scope.project.id=664d4ec0ca3642b4a61f49a61be6b8ba&role.id=a91a89818523427f9295a540fa435066 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:42.759815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7f9-039d-4a3d-979f-6bcefce9aa3a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.759994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7f9-039d-4a3d-979f-6bcefce9aa3a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.760270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7f9-039d-4a3d-979f-6bcefce9aa3a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.761687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 88/183] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:42.767685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.767970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.768246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.787928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:42.789191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:42.817964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca06c-f157-4142-bf39-ad4e2e684a05 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.818288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca06c-f157-4142-bf39-ad4e2e684a05 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.818538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca06c-f157-4142-bf39-ad4e2e684a05 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.820012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 89/184] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:42.825555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902837e-ec75-4644-a6a5-113d424f8534 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:42.825835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902837e-ec75-4644-a6a5-113d424f8534 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:42.826111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902837e-ec75-4644-a6a5-113d424f8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:42.848894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e902837e-ec75-4644-a6a5-113d424f8534 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:42.850125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e902837e-ec75-4644-a6a5-113d424f8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:42.883709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 96/185] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:42.884760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:42.944929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:42.970036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:42.997662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414fa6d-3802-4b44-8077-e45fdebd033d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.008258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aafa6-a69d-412a-a1e6-d74dccfaee61 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.008549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aafa6-a69d-412a-a1e6-d74dccfaee61 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.008799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aafa6-a69d-412a-a1e6-d74dccfaee61 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.010338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 91/187] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:43.015324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.015600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.015866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.038656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:43.040406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:43.051718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.052915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.053818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.054281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.068474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:43.075839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:43.076719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:43.077590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:43.080011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 97/188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:43.085991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.096062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.126850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 92/189] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:43.170874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.200359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7b76-d093-4903-be58-e5d6d4e52145 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.233493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.240471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.241079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.241357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.241629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.242429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:43.242768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.244335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.253631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 98/190] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:43.259254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.287803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcb955-f1cd-4b3f-84ab-8335a3d0c2be None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.324494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.325120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.325386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.325648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.343453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:43.348728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:43.349579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:43.350373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 93/191] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:43.351040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.371598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263703b8-559f-4231-b6c6-0cb87e4f1384 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.387677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.409900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.410560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.410837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.411107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.424732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.426183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.428081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 99/192] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:43.428908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.460954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b68c5-2909-4b16-85e6-03e7bb92ec3b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.476577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.495023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.495753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.495922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.496192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.507506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:43.512435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:43.513325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:43.514129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 94/193] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:43.519068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.526000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c12e-a436-4ceb-9351-eb9aa4b7be88 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.559110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.559633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.559903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.560168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.560812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:43.561104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.562465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.570101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 100/194] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:43.572789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.614337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.621626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200501e-186e-4075-b3c1-7f322af22ae2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.656531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.657148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.657420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.657686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.658796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.660240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.661781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 95/195] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:43.662551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.672655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed39a-d9c0-47eb-8b87-9dd3387e4d47 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.685443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.706603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.707200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.707475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.707743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.762405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeff5f-8765-4625-b3fe-1cccfadc3146 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.773612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.775976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.796248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.796843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.797111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.797378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.798023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:43.798313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.799701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.807742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 96/196] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:43.808501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.832908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.877127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 101/197] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:43.877127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.891566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:43.914858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b63ca-5b10-4792-b922-0b0ffa8f34d0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:43.949369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:43.949991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:43.950265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:43.950586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:43.951684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:43.953134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:43.954727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 97/198] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:43.957826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:43.978972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da680d-f707-42d9-b344-3e7fff361116 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.012957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.013537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.013805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.014071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.014732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.016174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.035793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 102/199] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:43 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:44.052095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.052246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.064308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603683c-530e-41d2-b4c6-43a51de96e7d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.103131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.103691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.103964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.104238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] PATH_INFO: `/v3/users/dc364178342443d1844f0d4c1d78a491` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.105395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] RBAC: Authorizing `identity:get_user(user_id=dc364178342443d1844f0d4c1d78a491)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.106887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.108500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 98/200] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:43 2022] GET /identity/v3/users/dc364178342443d1844f0d4c1d78a491 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:44.109273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.122247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.168651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70fb7-4375-4817-84db-007a8b47534a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.206913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.207552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.207824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.208091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.209208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.210684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.212702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 103/201] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:44.213185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.237076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9401b2-0f60-45ac-aae5-fcaaf0f70a3f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.277977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.278879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.279306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.279579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.313486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.330524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa3d9-3770-4071-a97d-e1f02bb0fcdc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.372494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.374054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.382359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.383007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.383314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.383581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.400144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.464978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.467231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.497161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 99/202] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:44.498787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.572113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.584773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 104/203] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:44.586514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.619188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad607ae-2e74-46c8-8edf-03a3d3645d57 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.632618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.658607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.659652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.660173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.660634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.661559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=64a62e4fdc794da0a1f5ad77c76604b4) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:44.662165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.663941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.670534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 100/204] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/role_assignments?user.id=64a62e4fdc794da0a1f5ad77c76604b4&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:44.676490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.743155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599723c8-d0fb-473a-ab7f-d576aaf35925 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.829371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad686f-b991-49e7-8a02-76543011053e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:44.831233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.831899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.832179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.832451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.839374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.840881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.842875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 105/205] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:44.848601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.857719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:44.870790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:44.871405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:44.871681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:44.871951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:44.873146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:44.874622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:44.876555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 101/206] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:44.882310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:44.996680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49417b-38c0-4188-9895-6e3f1f5eedc1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:45.005295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218b60-eb2e-4919-9c9f-f68ee7f2b73d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:45.026884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:45.034088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:45.034866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:45.035139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:45.035408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:45.036312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, scope.project.id=718b4d3572034c75a5cb6b4b423f6743, user.id=dc364178342443d1844f0d4c1d78a491) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:45.036618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:45.038158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7dfa6-6dc5-4bab-9051-121686cea716 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:45.041969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:45.042622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:45.042906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:45.043182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:45.043919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=64a62e4fdc794da0a1f5ad77c76604b4) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:45.044221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:45.045186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/role_assignments?user.id=dc364178342443d1844f0d4c1d78a491&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:45.045675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d91e7-b073-4069-ade1-92f014647d1b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:45.051723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:44 2022] GET /identity/v3/role_assignments?user.id=64a62e4fdc794da0a1f5ad77c76604b4&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:46.483335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a3d7a-c6b1-495d-b05b-5bfd85f8a3d7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:46.484347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a3d7a-c6b1-495d-b05b-5bfd85f8a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:46.484844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a3d7a-c6b1-495d-b05b-5bfd85f8a3d7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:46.486724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:46.491798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:46.492210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:46.492916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:46.512400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:46.513598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:46.524823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493711b-5886-4e32-9888-ad78e1d5607e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:46.525109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493711b-5886-4e32-9888-ad78e1d5607e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:46.525364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493711b-5886-4e32-9888-ad78e1d5607e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:46.526899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 104/210] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:46.531622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:46.531893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:46.532158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:46.552886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:46.554059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:46.584595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:46.609597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:46.628323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 105/212] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:46.864401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:46.906963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:46.967513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:46.971846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b1fa-50b2-46bf-97da-01360fb84826 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.008903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.009536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.009807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.010081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.015047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a9e19-2b30-4de0-94a3-88847ab4bff1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.021088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:47.026177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:47.027102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:47.027861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 108/213] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:47.033218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.057546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.058628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.059104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.059604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.061113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:47.062911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:47.065196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 106/214] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:47.075207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.145072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.151111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783745cd-091c-4d8f-973b-33dd4da46d6e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.188549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.189387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.189799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.190224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.191219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:47.191519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:47.192895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b842a-bb92-44cf-9749-552f37a4a63d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:47.194018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57660-ab56-48df-93b5-478b91e9cdf4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.202468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 109/215] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:47.208053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6299ad-ca44-4628-809f-ea021d30d634 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.208337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6299ad-ca44-4628-809f-ea021d30d634 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.208605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6299ad-ca44-4628-809f-ea021d30d634 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.213900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 110/216] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:47.213900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6299ad-ca44-4628-809f-ea021d30d634 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.230720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.231325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.231601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.231871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.232534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:47.233951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faac3a-6548-4260-b8a1-a53427821d9c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:47.237015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.257808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 107/217] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:47 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:47.264190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a99c-af2f-40e0-8e7a-58e57a875664 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.264475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a99c-af2f-40e0-8e7a-58e57a875664 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.264900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a99c-af2f-40e0-8e7a-58e57a875664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.287519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b905a99c-af2f-40e0-8e7a-58e57a875664 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:47.290259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b905a99c-af2f-40e0-8e7a-58e57a875664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:47.363032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6299ad-ca44-4628-809f-ea021d30d634 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.391489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 108/218] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:47.398905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d18f-3cfb-492c-8a6c-1adeeb6ac342 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.398905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d18f-3cfb-492c-8a6c-1adeeb6ac342 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.398905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d18f-3cfb-492c-8a6c-1adeeb6ac342 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.398905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 109/219] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:47.400679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.400956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.401222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.413840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.416122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.416612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.417065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] PATH_INFO: `/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.423492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:47.424699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:47.436834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] RBAC: Authorizing `identity:get_user(user_id=d22a8e2fc4e14d6a8ed62fd54fe0e588)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:47.439615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:47.442440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 111/220] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:47.448084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.466311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.509902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 110/221] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:47.548567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.574790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393a353-86c8-4204-aad4-cbb4bf503479 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.611600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.612210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.612485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.612817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.668038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.687854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:47.689531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:47.779886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.794428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db27d6-12ec-4515-b596-46f7abc01a33 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.809601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 112/222] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 15:59:47.814657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.840974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.841616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:47.841890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:47.842158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:47.854221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:47.859473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:47.860538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 111/223] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:47.861438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:47.896045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:47.950584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a67a7-7070-4441-b280-bbddffeb65ec None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.986793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7bf3-a252-46fb-8a7d-2380ff62d193 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:47.996304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:47.998082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.000732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.001186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.036556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.037194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.037469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.037742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.039236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:48.044764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:48.045612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:48.046367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:48.046984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.052563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.054929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 113/224] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:48.055840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.056538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 112/225] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:47 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.057349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.149498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:48.248907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:48.257170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6bfc5-2e34-4946-a813-4640cf0959d6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.262173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6123b-b63a-439c-ab2a-085b898db974 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.324958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.325522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.326137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.326403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.326530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.326781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.327450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:48.327752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.328017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.328468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.329130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.329513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:48.334890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.336806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.345527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 113/226] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.345527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.358947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 114/227] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.361859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.540890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72123-4468-4642-b758-88a845dcc82c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.548574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:48.553373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1a23-e37d-468e-bfdd-2b643b321c08 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.580212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.580817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.581092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.581361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.582340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=d22a8e2fc4e14d6a8ed62fd54fe0e588) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:48.582691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.584875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.592275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 114/228] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/role_assignments?user.id=d22a8e2fc4e14d6a8ed62fd54fe0e588&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a91a89818523427f9295a540fa435066 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.602515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.611707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.612368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.612642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.612909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.614202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.615713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.619931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 115/229] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.627419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.651435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:48.783003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298290a8-0fa4-4a85-9d93-518da9778481 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.826359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.826950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.827708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.827995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.829470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.831222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.833025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 116/230] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:48.838887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.840672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620b34-d060-4e4a-884b-f8bdedc39add None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:48.882641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:48.891311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:48.892501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:48.892985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:48.893446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:48.898302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:48.900223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:48.902723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 115/231] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:48.908474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:48.972221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106dd6-f7d6-441e-9d24-6c9adf08ea6b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:49.032496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:49.033256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.033633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.033911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/64a62e4fdc794da0a1f5ad77c76604b4/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.036089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, user_id=64a62e4fdc794da0a1f5ad77c76604b4, role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:49.037706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:49.070653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 117/232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:48 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/64a62e4fdc794da0a1f5ad77c76604b4/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:49.075834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:49.085750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a488d3-4ced-4990-bdb6-87eefa741bf0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:49.123397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:49.124188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.124721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.125096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.126865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:49.128578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c084e9-8f35-4cba-84eb-30d9b47ad0be None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:49.130887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 116/233] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:48 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:49.136798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:49.286356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:49.296254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e6eb-227a-4ad4-a8d0-2a410ff8ae2e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:49.334764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:49.335689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.336858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.337279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/64a62e4fdc794da0a1f5ad77c76604b4/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.340335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, user_id=64a62e4fdc794da0a1f5ad77c76604b4, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:49.341933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890df0ae-35be-4465-8d03-f763bafd03ae None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:49.360994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 118/234] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:49 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/64a62e4fdc794da0a1f5ad77c76604b4/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:49.970212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67938f-4344-4e39-9a20-8bc03c5f27e5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.970778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67938f-4344-4e39-9a20-8bc03c5f27e5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.970852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67938f-4344-4e39-9a20-8bc03c5f27e5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.972452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 117/235] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:49.977531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.977920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.978109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.992064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02061d-f7b9-4b84-983c-a6297f76728a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:49.992885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02061d-f7b9-4b84-983c-a6297f76728a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:49.993158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02061d-f7b9-4b84-983c-a6297f76728a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:49.994571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 118/236] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:50.000031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:50.000312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:50.000584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:50.003558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:50.004984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:50.040236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:50.041790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:50.108803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 119/237] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:50.131516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 119/238] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:50.472334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:50.501171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:50.637731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:50.669826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad00aa-974c-4ae8-9706-2e09d91cc951 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:50.698832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:50.714832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242ace-e5ab-4122-8009-ee7b74b5aa54 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:50.740476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:50.741130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:50.741403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:50.741671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:50.743081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:50.744648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:50.746549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 120/239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:50.753416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:50.789098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:50.790317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:50.790615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:50.790880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:50.819154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:50.824329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:50.825209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:50.825976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:50.833617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 120/240] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:50.839997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:50.880708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a79a-a9d9-4447-b338-877a074a571f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:50.917370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:50.917901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:50.918230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:50.918537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:50.919192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:50.921051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:50.959870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 121/241] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:50 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:51.008933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c8f14-941e-4c72-8890-b913a37a7cd6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.049024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:51.049782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.050061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.050372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.051094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:51.051441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:51.053099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:51.062522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 121/242] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:51.068509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:51.084317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.220352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164303-22a2-4b2f-a670-2b8743901d67 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.256382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:51.257015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.257294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.257567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] PATH_INFO: `/v3/users/dcd21df467554dd7bbb04d75b2a3fad2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.272320 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] RBAC: Authorizing `identity:get_user(user_id=dcd21df467554dd7bbb04d75b2a3fad2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:51.274395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d072c-2863-42cf-975c-7615ff04261b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:51.278985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 122/243] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/users/dcd21df467554dd7bbb04d75b2a3fad2 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:51.282047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:51.298858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.334022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2b82-41ec-45fd-a12e-c3f6eb4c86bb None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.334546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2b82-41ec-45fd-a12e-c3f6eb4c86bb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.334953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2b82-41ec-45fd-a12e-c3f6eb4c86bb None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.337017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 123/244] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:51.342621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.343065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.343499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.368173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:51.369611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:51.393550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934b18f-8f04-4820-a10d-9806ac910114 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.433489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:51.434632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.435450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.436141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.441451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.447871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 124/245] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:51.510687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:51.512098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:51.527358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.618219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 122/246] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:51.623845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:51.736134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922bdd-dfc4-498b-8acd-71ec7036a189 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.767803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:51.783051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:51.783694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.783973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.784310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.785795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:51.788070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:51.793898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 125/247] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:51.798381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:51.901852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.907982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343f647-967c-48e2-a979-4bcab12028a9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.927758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:51.955715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:51.956705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.957193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.957303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a608ed-c596-45ea-8c5f-e78176562904 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:51.957753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.978535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2fb3d958-678c-4b60-a89b-b0f8c96116ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:51.983476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:51.984369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:51.985136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 123/248] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:51.985778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b0fb1-1437-4060-b550-184ef7cae8cb None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:51.986306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b0fb1-1437-4060-b550-184ef7cae8cb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:51.986306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b0fb1-1437-4060-b550-184ef7cae8cb None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:51.988165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 124/249] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:51.994303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b0fb1-1437-4060-b550-184ef7cae8cb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.015329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.016534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.017389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.017913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.018878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=dcd21df467554dd7bbb04d75b2a3fad2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:52.019378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:52.021711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823565-2b2d-4aef-83ed-e021bfaa46be None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:52.031083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 126/250] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/role_assignments?user.id=dcd21df467554dd7bbb04d75b2a3fad2&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:52.033271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeac90-03d3-4aa5-9b76-2e79fd8a09fd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.034064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeac90-03d3-4aa5-9b76-2e79fd8a09fd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.034707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeac90-03d3-4aa5-9b76-2e79fd8a09fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.060916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3faeac90-03d3-4aa5-9b76-2e79fd8a09fd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:52.062515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3faeac90-03d3-4aa5-9b76-2e79fd8a09fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:52.123811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b0fb1-1437-4060-b550-184ef7cae8cb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:52.174519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 127/251] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:52.174519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9283-c073-4e14-8f48-426308eae86f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.174519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9283-c073-4e14-8f48-426308eae86f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.174519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9283-c073-4e14-8f48-426308eae86f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.174519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 128/252] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:52.181008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.181284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.181557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.192156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.193017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.193462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.193875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.194715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:52.195178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:52.197292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:52.202509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:52.202817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:52.222062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 125/253] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:52.227827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.323247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:52.323838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:52.343069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 129/254] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:52.408715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f2af-89b7-40a1-979c-f1441a86180e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:52.443718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.444351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.444623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.444890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] PATH_INFO: `/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.446650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=d22a8e2fc4e14d6a8ed62fd54fe0e588)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:52.448085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:52.449951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 126/255] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:52 2022] GET /identity/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:52.455398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.589348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8c520-9335-4582-9e87-b05e641bdccd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:52.614288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.636443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.637083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.637358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.637624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.638828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:52.640565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:52.642657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 130/256] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:52 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:52.651138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.760457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:52.803682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f39f4-9303-4a9e-875c-7fabe3e08cc5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:52.808158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:52.848631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3f56-979e-4ac3-8441-442e8b2bc962 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:52.881961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.882615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.883438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.883712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.902350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:52.907724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:52.908592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:52.909368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 127/257] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 15:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:52.910011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:52.914211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:52.914941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:52.915222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:52.915493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/d22a8e2fc4e14d6a8ed62fd54fe0e588/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:52.918400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, user_id=d22a8e2fc4e14d6a8ed62fd54fe0e588, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:52.919947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:52.944887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 131/258] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:52 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/d22a8e2fc4e14d6a8ed62fd54fe0e588/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:59:52.946629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.102381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754120a-546b-4639-89b6-0a8ba5d91f53 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.134378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657267-fb89-41ba-bb56-c7673e79fe8e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.154532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.155238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.156210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.156210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.174207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:53.183490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:53.198947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:53.201795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:53.203912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 128/259] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 15:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:53.211553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.212758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.213479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.213769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.214039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.215113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:53.215495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:53.216915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:53.236928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 132/260] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 15:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:53.243409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.259571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:53.396194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6aa2-e373-4397-8d7c-f6a8f0f45483 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.424329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefbb78-f259-4f8f-9349-914635097c80 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.460408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.461415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.461888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.462352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.463245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:53.463738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:53.465453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:53.482253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 129/261] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:53.487023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.487890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.489111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.489924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.492269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.494932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:53.496606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:53.503407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 133/262] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:53 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:53.511189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.599213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:53.635254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:53.667344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ecd0b-d3c7-48d7-a34d-8fbf2c403b16 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.691833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d5ef-1d15-4361-a587-6d2b613ca5df None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:53.729236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.729966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.730241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.730545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] PATH_INFO: `/v3/users/64a62e4fdc794da0a1f5ad77c76604b4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.738584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] RBAC: Authorizing `identity:get_user(user_id=64a62e4fdc794da0a1f5ad77c76604b4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:53.738584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:53.738584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 130/263] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:53 2022] GET /identity/v3/users/64a62e4fdc794da0a1f5ad77c76604b4 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:53.743438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:53.744054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:53.744326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:53.744592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:53.749659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:53.925547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:53.927225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:53.996995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e48b-7559-4257-abc0-feca683ad2fa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:54.033387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:54.034350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.034843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.035331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.046701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:54.063296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:54.108676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:54.110457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:54.142464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 134/264] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 15:59:54.164771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:54.217896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 131/265] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 15:59:54.223176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:54.306903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:54.415316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a682b-37d6-40a8-9610-1a3eeb6d9cec None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:54.458294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ca71-32b7-426d-a4c7-599ad39223ba None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:54.496601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:54.497474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.497958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.498350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.503607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:54.505145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc808b9e-01ae-44d5-95cf-1c0d9a590038 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:54.507563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 132/266] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:54 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:54.514858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e422f-5d5b-4a67-9b9a-cb2018465b9b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.514858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e422f-5d5b-4a67-9b9a-cb2018465b9b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.514858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e422f-5d5b-4a67-9b9a-cb2018465b9b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.514858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 133/267] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:54.518092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e422f-5d5b-4a67-9b9a-cb2018465b9b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:54.539722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:54.540362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.540637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.540905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.543352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:54.544794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba37a0e-14e6-49b0-8dd6-2d759f77a345 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:54.546410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 135/268] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:54 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:54.549221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.549496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.549775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.584259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:54.585447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:54.607206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:54.714955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 136/269] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:54.715804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:54.740335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e422f-5d5b-4a67-9b9a-cb2018465b9b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:54.830905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:54.832389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.832872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.833337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.834613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=64a62e4fdc794da0a1f5ad77c76604b4) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:54.835127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:54.837515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c029-0724-42f0-a196-da7081fc97f6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:54.842695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:54.850779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 134/270] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:54 2022] GET /identity/v3/role_assignments?user.id=64a62e4fdc794da0a1f5ad77c76604b4&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:54.864761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720935b-ec49-4d1b-92fe-c4d278512d54 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.865301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720935b-ec49-4d1b-92fe-c4d278512d54 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.865736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720935b-ec49-4d1b-92fe-c4d278512d54 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.867326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 135/271] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:59:54.875509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:54.876012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:54.876426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:54.896238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:54.897739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:54.989202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 136/272] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:55.010233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119a52f-12a5-4f25-a139-9b0252724fff None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.076508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.077109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.077382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.077646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.078369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=64a62e4fdc794da0a1f5ad77c76604b4) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:55.078699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:55.083246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:55.090639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 137/273] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:54 2022] GET /identity/v3/role_assignments?user.id=64a62e4fdc794da0a1f5ad77c76604b4&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 608 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:55.122273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.270074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fade827-eb2f-4f55-973e-42e73044d42f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.291358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:55.323546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974583f-907e-402b-b280-95365673050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.324266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974583f-907e-402b-b280-95365673050c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.324542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974583f-907e-402b-b280-95365673050c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.324808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974583f-907e-402b-b280-95365673050c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.336914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974583f-907e-402b-b280-95365673050c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e974583f-907e-402b-b280-95365673050c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:55.341848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:55.342732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:55.343497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:55.349331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.383418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:55.421420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974583f-907e-402b-b280-95365673050c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.529909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549cd6-689c-4d11-8aa7-1c09626ef2c0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.579683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974583f-907e-402b-b280-95365673050c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.580170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.581244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.581717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.582889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.583610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:55.583916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:55.585319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:55.596141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:55.602564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.629733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.630774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.631266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.631679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.633761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:55.636282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:55.638342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 138/276] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:55.645565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.691491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:55.702988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:55.729460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ea308-efc3-4232-bf17-b0ac9047ddde None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.764380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.764942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.765223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.765651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] PATH_INFO: `/v3/users/4d7ae817cef742558274ba8a76aec048` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.768371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1d2b-62d6-425d-9f64-c6509935babb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.780095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] RBAC: Authorizing `identity:get_user(user_id=4d7ae817cef742558274ba8a76aec048)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:55.781550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80040c-9e74-4c35-8d46-d3139206237c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:55.783354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 139/277] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:55 2022] GET /identity/v3/users/4d7ae817cef742558274ba8a76aec048 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:55.787733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d44d-47bc-441f-9ca6-5d9b8a577903 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.788016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d44d-47bc-441f-9ca6-5d9b8a577903 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.788286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d44d-47bc-441f-9ca6-5d9b8a577903 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.791364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 140/278] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:55.792267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d44d-47bc-441f-9ca6-5d9b8a577903 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:55.813361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.813987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.814264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.814563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.815676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:55.817231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337fe0-769d-43e9-95fb-5bc5e77f0d86 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:55.849900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 139/279] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 15:59:55 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:55.849900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cceda0-e18d-47a7-9ae8-df440c12f729 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.849900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cceda0-e18d-47a7-9ae8-df440c12f729 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.849900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cceda0-e18d-47a7-9ae8-df440c12f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.865084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b9cceda0-e18d-47a7-9ae8-df440c12f729 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:55.866428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b9cceda0-e18d-47a7-9ae8-df440c12f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:55.942170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d44d-47bc-441f-9ca6-5d9b8a577903 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:55.958586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 140/280] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:55.972288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9aea-983d-4ecd-9e79-e31492aa618d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.972570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9aea-983d-4ecd-9e79-e31492aa618d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.972840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9aea-983d-4ecd-9e79-e31492aa618d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.976043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 141/281] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:55.980546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.980824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.981142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.986232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:55.994622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:55.995471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:55.995906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:55.996967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:55.997871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, user.id=4d7ae817cef742558274ba8a76aec048, scope.system=all) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:55.998626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:56.000252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:56.002796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:56.004246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:56.007227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 141/282] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Sep 19 15:59:55 2022] GET /identity/v3/role_assignments?user.id=4d7ae817cef742558274ba8a76aec048&scope.system=all&role.id=a91a89818523427f9295a540fa435066 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:56.035127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.094594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 142/283] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 15:59:56.238507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.348060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e289b0-232a-4e94-af93-e1d5b729dde6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.385412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:56.386330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:56.386797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:56.387233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:56.394149 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.404234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:56.409826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:56.410713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:56.411493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:56.413786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 142/284] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:56.420335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.554892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.592138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4599-d3c4-4511-9411-5c94f9befe61 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.631063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:56.631696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:56.631974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:56.632244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:56.644472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d0ab-99ce-4577-a907-db05f93d4223 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.657964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:56.663143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:56.664044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:56.664830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:56.667829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 143/285] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:56.673988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.717017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.720319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:56.721324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:56.721792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:56.722313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:56.723193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:56.723711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:56.730506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:56.744771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 143/286] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:56.750647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.811647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a12d9-9598-45db-a7e1-415bf097f818 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.852301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:56.852908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:56.853183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:56.853451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:56.854199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:56.854510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:56.858524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:56.866063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 144/287] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:56.873118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:56.967513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:56.968918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4def62-3666-49a5-b8c8-458b6c1cafb2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.989250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82ce3-e288-4d30-a45a-80aa1910119d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:56.998023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.030870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.031931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.032405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.032870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] PATH_INFO: `/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.034297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] RBAC: Authorizing `identity:get_user(user_id=d22a8e2fc4e14d6a8ed62fd54fe0e588)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.036133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.038019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 145/288] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/users/d22a8e2fc4e14d6a8ed62fd54fe0e588 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:57.039733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.040374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.040647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.040913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] PATH_INFO: `/v3/users/dcd21df467554dd7bbb04d75b2a3fad2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.043184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] RBAC: Authorizing `identity:get_user(user_id=dcd21df467554dd7bbb04d75b2a3fad2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.044888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.046954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 144/289] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:56 2022] GET /identity/v3/users/dcd21df467554dd7bbb04d75b2a3fad2 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:57.052295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:57.060285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:57.251530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebc5a-434c-4735-8751-cc902fdc3f51 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:57.272439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42560f-b138-4ba5-bf38-7161dbdbcb5c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:57.300254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.300879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.301157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.301431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.342318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.342979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.343254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.343528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.344766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.346213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.347867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 146/290] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:57 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:57.354590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:57.392537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.407070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.455264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.456741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.524971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6aadb2-9483-49c2-a6b7-e9ae25b87ddd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:57.591231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.591889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.592164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.592438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/dcd21df467554dd7bbb04d75b2a3fad2/roles/a136b0fbdd82447faf4932746f2c04f8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.596038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, user_id=dcd21df467554dd7bbb04d75b2a3fad2, role_id=a136b0fbdd82447faf4932746f2c04f8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.597492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.618034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 147/291] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 15:59:57 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/users/dcd21df467554dd7bbb04d75b2a3fad2/roles/a136b0fbdd82447faf4932746f2c04f8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:57.630336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 15:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 15:59:57.640008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:57.758901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.781677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd27e7-3fdb-40b7-8fb7-b50d248edbfb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:57.835877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:57.837266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:57.837529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:57.837800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:57.843354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:57.844831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39458df2-a6a0-41a8-820b-38ba8324799d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:57.846613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 15:59:57 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:57.855641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:57.972353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:57.990267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d4fd3-1304-4f9b-81b0-cf5c8f469c63 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:58.033980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:58.034527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.034808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.035081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.035815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=d22a8e2fc4e14d6a8ed62fd54fe0e588) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:58.036258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:58.037705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af104-cb76-42a5-b968-0ffbc1e1b61a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:58.044683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 15:59:57 2022] GET /identity/v3/role_assignments?user.id=d22a8e2fc4e14d6a8ed62fd54fe0e588&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a91a89818523427f9295a540fa435066 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:58.392636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03eab-de9c-4524-b415-e89617fc84fd None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.392974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03eab-de9c-4524-b415-e89617fc84fd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.393181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03eab-de9c-4524-b415-e89617fc84fd None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.394761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:58.400857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624142e3-3269-4bcc-90be-515ee7285e07 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.401148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624142e3-3269-4bcc-90be-515ee7285e07 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.401404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624142e3-3269-4bcc-90be-515ee7285e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.425301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-624142e3-3269-4bcc-90be-515ee7285e07 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:58.426552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-624142e3-3269-4bcc-90be-515ee7285e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:58.515921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:58.533017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122597-437f-4bbf-ae61-924e06ca5e89 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.533516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122597-437f-4bbf-ae61-924e06ca5e89 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.533592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122597-437f-4bbf-ae61-924e06ca5e89 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.535145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 150/297] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:58.541372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68184c-37bf-47f4-8672-5b35a32598d2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.541653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68184c-37bf-47f4-8672-5b35a32598d2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.541928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68184c-37bf-47f4-8672-5b35a32598d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.561167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6d68184c-37bf-47f4-8672-5b35a32598d2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:58.562351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6d68184c-37bf-47f4-8672-5b35a32598d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:58.638778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 148/298] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:58.753033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee205-5d2b-4bb8-a9cb-7b803a2b19cb None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.753673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee205-5d2b-4bb8-a9cb-7b803a2b19cb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.754135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee205-5d2b-4bb8-a9cb-7b803a2b19cb None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.755695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 151/299] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 15:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:59:58.761590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.762097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.762636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.781368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:59:58.782893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:59:58.785102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:58.798314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee205-5d2b-4bb8-a9cb-7b803a2b19cb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:58.856003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 15:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 15:59:58.909540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:58.919984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee205-5d2b-4bb8-a9cb-7b803a2b19cb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:58.965643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:58.966274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:58.966601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:58.967258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:58.983267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:58.989943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:58.990898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 15:59:58.992281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 152/301] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 15:59:58.996629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.002981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.030421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97094c70-7ac2-43f5-b78b-3ac8e3d48cc6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.078068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.079032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.079481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.080145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.093292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.099767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 15:59:59.106860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:59:59.107919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 15:59:59.108758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 15:59:59.116706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 150/302] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 15:59:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 15:59:59.118591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.127119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d36c-a9f3-4bce-982c-bccf29c898e8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.163767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.165141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.165413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.165680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.166708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:59.167002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.168368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.176755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 153/303] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:59.176755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.231409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33decb-3dd2-4c43-9416-b883262c4d2c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.250290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.267768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.268366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.268638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.268908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.269587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:59.269887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.271291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.280061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 151/304] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 15:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:59:59.284015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.288690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb2cfe-5970-48f8-b19c-76ebbc18dbc0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.325868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.326500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.330894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.331741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.332960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.334996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.341514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 15:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:59.341514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.347989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.396766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4cc4-b0ee-4927-a0a9-de7afca8ef3d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.436154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.436702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.436977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.437251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] PATH_INFO: `/v3/users/4d7ae817cef742558274ba8a76aec048` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.438594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] RBAC: Authorizing `identity:get_user(user_id=4d7ae817cef742558274ba8a76aec048)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.439838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.441740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 152/306] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:59 2022] GET /identity/v3/users/4d7ae817cef742558274ba8a76aec048 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:59.442572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.447160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc83e3-75c1-48ac-962d-1b1e81634ce8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.484210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.485199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.485541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.485877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] PATH_INFO: `/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.487856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.502558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ceac7f6868946d6bc9f50e446ad6ec9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.504026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.505639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 155/307] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 15:59:59 2022] GET /identity/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:59:59.508587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.542817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e66fa-eff5-40da-8d4e-eed04f22f8ec None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.568079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:59:59.576890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.577490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.577764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.578034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] PATH_INFO: `/v3/groups` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.578707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.580144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.595189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 153/308] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Sep 19 15:59:59 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:59:59.595990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:59:59.639792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f49-cd9a-440b-97a1-5c12676697d1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.682825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.683778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.684292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.684732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] PATH_INFO: `/v3/system/users/4d7ae817cef742558274ba8a76aec048/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.688082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d7ae817cef742558274ba8a76aec048, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.689769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75552246-4fb0-4134-a41d-cf8fb913e751 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.702826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 156/309] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Sep 19 15:59:59 2022] PUT /identity/v3/system/users/4d7ae817cef742558274ba8a76aec048/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:59:59.741100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be608d-1b3a-46ab-89ff-c1ad56f78016 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:59:59.784882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:59:59.786012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:59:59.786463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:59:59.786937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:59:59.787953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, user.id=3ceac7f6868946d6bc9f50e446ad6ec9, scope.system=all) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:59:59.788508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:59:59.790943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06446993-27ee-4c8f-83d0-75e8d5aed1ba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:59:59.797387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 154/310] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Sep 19 15:59:59 2022] GET /identity/v3/role_assignments?user.id=3ceac7f6868946d6bc9f50e446ad6ec9&scope.system=all&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:00.161744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0b3a-b00c-4729-b7f7-0ba667447dac None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:00.162143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0b3a-b00c-4729-b7f7-0ba667447dac None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:00.162326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e0b3a-b00c-4729-b7f7-0ba667447dac None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:00.163786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 157/311] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:00.169598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:00.169874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:00.170154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:00.188854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:00.190030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:00.239027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:00.262037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 155/312] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:00.530795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e0b3a-b00c-4729-b7f7-0ba667447dac None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:00.590476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:00.645558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e0b3a-b00c-4729-b7f7-0ba667447dac None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:00.682347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:00.683001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:00.683274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:00.683542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:00.696731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:00.702259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:00.703245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:00.704218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 158/313] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:00.709381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:00.808664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fc180-4f37-42c4-bfd1-b34fb82ab383 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:00.846892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:00.847503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:00.847781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:00.848114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:00.848776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:00.849119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:00.850522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:00.859038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 156/314] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:00.864363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:00.976257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4898f-d878-4465-89c2-33b2bd1fe3da None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:00.993271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:01.013260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:01.013943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.014274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.014668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] PATH_INFO: `/v3/users/dcd21df467554dd7bbb04d75b2a3fad2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.015830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] RBAC: Authorizing `identity:get_user(user_id=dcd21df467554dd7bbb04d75b2a3fad2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:01.017367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:01.019302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 159/315] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:00:00 2022] GET /identity/v3/users/dcd21df467554dd7bbb04d75b2a3fad2 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:01.024986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:01.078648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:01.139949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a0e5a-7cf2-4e30-b9a7-e9d5e466d8f8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:01.175236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:01.176157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.176656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.177376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.246730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:01.248485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:01.293721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:01.362502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 157/316] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:01.364840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:01.474168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c42b-5662-4fc5-b694-d2479f12023c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:01.508063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:01.508685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.508954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.509217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.510368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:01.511834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c350-c889-407c-b1fe-a9606c194c32 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:01.513499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 160/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:01 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:01.519357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:01.625400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9d6c-ec4d-426d-ac91-c461cf2c035d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:01.662003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:01.662647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.662922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.663188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.663945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, scope.project.id=79edb0b34aae40ccbbd22ba26110a573, user.id=dcd21df467554dd7bbb04d75b2a3fad2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:01.664259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:01.665688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c52f9-307c-4198-91b6-5954c813f645 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:01.672069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 158/318] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:01 2022] GET /identity/v3/role_assignments?user.id=dcd21df467554dd7bbb04d75b2a3fad2&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:01.983944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ecbf-ecc4-4fcc-8412-5961b0108af0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.984448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ecbf-ecc4-4fcc-8412-5961b0108af0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.984448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134ecbf-ecc4-4fcc-8412-5961b0108af0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.985758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 161/319] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:01.989231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be2e7-9472-4c9a-ab12-1d9f2329435d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.989704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be2e7-9472-4c9a-ab12-1d9f2329435d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.989775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94be2e7-9472-4c9a-ab12-1d9f2329435d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.991201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 159/320] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:01.991748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ad10-f744-4a0c-95b8-7ed140645ed4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.992559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ad10-f744-4a0c-95b8-7ed140645ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.992910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ad10-f744-4a0c-95b8-7ed140645ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:01.998124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535d41-5dbd-4a34-852a-0443ec13487e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:01.998508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535d41-5dbd-4a34-852a-0443ec13487e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:01.998793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535d41-5dbd-4a34-852a-0443ec13487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.015736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c0d4ad10-f744-4a0c-95b8-7ed140645ed4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:02.016913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c0d4ad10-f744-4a0c-95b8-7ed140645ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:02.018330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-49535d41-5dbd-4a34-852a-0443ec13487e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:02.019551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-49535d41-5dbd-4a34-852a-0443ec13487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:02.021540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.072247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.096616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 160/321] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:02.096831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 162/322] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:02.096913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394aaf-a85a-40a2-b81f-603f9bedeb14 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.096913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394aaf-a85a-40a2-b81f-603f9bedeb14 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.096913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394aaf-a85a-40a2-b81f-603f9bedeb14 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.096913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 161/323] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:02.102705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.102994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.103271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.122504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:02.123682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:02.190810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 163/324] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:02.360668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394aaf-a85a-40a2-b81f-603f9bedeb14 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.363453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.466274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394aaf-a85a-40a2-b81f-603f9bedeb14 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.468585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93fa8d-4d26-41c5-9e59-208e21de129c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.482200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.500927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.501545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.501814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.502078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.504217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.504835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.505105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.505378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.506458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:02.507943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:02.508594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.509517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:02.511343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.513257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:02.518468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:02.519342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:02.520141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 162/326] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:02.520770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.609830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead89c1a-a8c4-4ef6-802e-7dcc6b6fd6c0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.617686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04bb0-7404-4880-913b-99747b289db8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.643169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.643781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.644050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.644313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.650969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.651549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.651822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.652085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] PATH_INFO: `/v3/groups` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.652691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:02.654149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:02.654295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:02.659612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:02.660665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:02.661572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 165/327] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:02.662803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.671639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 163/328] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Sep 19 16:00:02 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:02.671639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.713044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.746451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.779137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38859d-4aaa-4b73-ae81-0c891c8122b9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.795601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abef2c-0047-4089-ba4a-9404e1a042bf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.817406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.818016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.818290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.818588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.819260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:02.819554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:02.821008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:02.830118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 166/329] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:02.834791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.835679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.836326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.836768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.837225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.838098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:02.838614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:02.840444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:02.849881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 164/330] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:02.855934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:02.951027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f8641-fbe3-4a3b-8af5-1f4cb45b0d25 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.952293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:02.987838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da54bff-b6f0-467e-b065-ae4e380c44c7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:02.993557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:02.994189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:02.994459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:02.994757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] PATH_INFO: `/v3/users/4d7ae817cef742558274ba8a76aec048` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:02.997418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] RBAC: Authorizing `identity:get_user(user_id=4d7ae817cef742558274ba8a76aec048)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:02.999344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:03.004710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/users/4d7ae817cef742558274ba8a76aec048 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:03.008507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:03.013402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:03.029344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:03.029979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:03.030256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:03.030554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] PATH_INFO: `/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:03.031930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3ceac7f6868946d6bc9f50e446ad6ec9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:03.033131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:03.036073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 165/332] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:00:02 2022] GET /identity/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:03.045214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:03.130227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d04016-5737-428d-aaf0-e9a741b358f2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:03.170365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311473-f50b-4181-8800-4c83ef6c36f5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:03.172477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:03.173193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:03.173464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:03.173754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:03.174448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] RBAC: Adding query filter params (role.id=a91a89818523427f9295a540fa435066, user.id=4d7ae817cef742558274ba8a76aec048, scope.system=all) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:03.174815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:03.176196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226caf8-c423-4a16-acaf-401b7f739229 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:03.190212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 168/333] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Sep 19 16:00:03 2022] GET /identity/v3/role_assignments?user.id=4d7ae817cef742558274ba8a76aec048&scope.system=all&role.id=a91a89818523427f9295a540fa435066 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:03.214107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:03.214730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:03.215004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:03.215276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] PATH_INFO: `/v3/system/users/3ceac7f6868946d6bc9f50e446ad6ec9/roles/a136b0fbdd82447faf4932746f2c04f8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:03.216786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ceac7f6868946d6bc9f50e446ad6ec9, role_id=a136b0fbdd82447faf4932746f2c04f8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:03.218198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95075a65-7696-40f9-9bdc-7a04ad204d56 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:03.232060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 166/334] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Sep 19 16:00:03 2022] PUT /identity/v3/system/users/3ceac7f6868946d6bc9f50e446ad6ec9/roles/a136b0fbdd82447faf4932746f2c04f8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:05.123936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e24f52-9aeb-42b5-ba02-278cd45b0c1e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.124438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e24f52-9aeb-42b5-ba02-278cd45b0c1e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.124512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e24f52-9aeb-42b5-ba02-278cd45b0c1e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.125940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:05.131638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50c2-49e4-474e-8467-d75c31261aca None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.132467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50c2-49e4-474e-8467-d75c31261aca None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.133573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50c2-49e4-474e-8467-d75c31261aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.156635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-938d50c2-49e4-474e-8467-d75c31261aca None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:05.158336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-938d50c2-49e4-474e-8467-d75c31261aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:05.223262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:05.250025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:05.541003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e24f52-9aeb-42b5-ba02-278cd45b0c1e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:05.572658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:05.655802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e24f52-9aeb-42b5-ba02-278cd45b0c1e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:05.661042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1f2f9-f6ef-4603-9414-8fa0701335bc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.661577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1f2f9-f6ef-4603-9414-8fa0701335bc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.662050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1f2f9-f6ef-4603-9414-8fa0701335bc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.663689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 168/337] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:05.669846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8257-2948-4da4-8b19-fdcea5cc3106 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.670118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8257-2948-4da4-8b19-fdcea5cc3106 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.670383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec8257-2948-4da4-8b19-fdcea5cc3106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.700668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:05.701676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.702173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.702678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.709912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c7ec8257-2948-4da4-8b19-fdcea5cc3106 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:05.712077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c7ec8257-2948-4da4-8b19-fdcea5cc3106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:05.715243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:05.721909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:05.722804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:05.723588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:05.730762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 170/338] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:05.733476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:05.834666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:05.848173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 169/339] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:05.848900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023a796-266d-41d4-b2b0-719b6de5b314 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:05.849434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e42a-8168-4cc9-90d2-2f3007c550fc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.849714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e42a-8168-4cc9-90d2-2f3007c550fc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.849984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e42a-8168-4cc9-90d2-2f3007c550fc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.851387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 170/340] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:05.864205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.864517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.864745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.889998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:05.890995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:05.891594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:05.892063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:05.892985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:05.893480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:05.894476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:05.895386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:05.895692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:05.908851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 171/341] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:05.916224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:05.980518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 171/342] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:06.029869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ac6e-6d61-408f-8811-5adf721221f6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:06.068467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:06.069425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.069902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.070928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.099013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:06.143408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:06.144946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:06.252025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 172/343] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:06.258438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.311490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:06.321417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.399078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:06.453883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c421d-4425-4a39-8768-6e53f9118a98 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:06.488359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578368-cf94-44a4-97ca-23934e1a03d9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:06.510094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:06.510757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.511030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.511301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.513080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:06.514638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e0025-5ce6-433b-a3cd-e27615e12e50 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:06.518366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 172/344] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:06.519550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834039e-3457-4f52-a477-30f8736b1d64 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.520711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834039e-3457-4f52-a477-30f8736b1d64 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.520991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834039e-3457-4f52-a477-30f8736b1d64 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.523301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 173/345] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:06.525536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834039e-3457-4f52-a477-30f8736b1d64 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.554918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:06.555683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.555966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.556237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.568816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-50e50db2-a3f3-48ef-afc9-909fbb8d2def None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:06.574922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:06.575843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:06.577036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 173/346] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:06.577723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.577887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.578162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.598500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:06.600803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:06.666266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834039e-3457-4f52-a477-30f8736b1d64 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:06.682503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:06.691434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 174/347] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:06.692236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.747736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:06.748372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.748649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.748927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.761347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:06.762841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:06.769175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 174/348] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:06.770011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.772593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:06.868650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e70fb-4499-40a0-8d21-5455372e3b90 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:06.923066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:06.923613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:06.923882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:06.924148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:06.943648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:06.949396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:06.950299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:06.951584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 175/349] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:06.952246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:06.974578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f3163-c76e-4024-a792-3f8843b345a7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.024088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.024697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.024972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.025243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.026005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:07.026305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.027816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.037178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 175/350] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:07.038005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.081063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.084407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d42c6f-bebd-44fa-8e67-f6f2aa78c8a2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.088892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.122809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.123420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.123694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.123970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.124754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=a91a89818523427f9295a540fa435066, scope.project.id=718b4d3572034c75a5cb6b4b423f6743) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:07.125067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.126524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.132205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 176/351] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:06 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a91a89818523427f9295a540fa435066 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:07.133025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.165211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9d73-e9c0-4dc8-accf-562f1f68c82f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.239454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.240459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.240728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.240995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.242744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:07.243044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.244460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.260430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 176/352] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:07.261287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.372594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb988-25d2-4b91-bb69-cc9538ac39bc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.426848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.431711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609a43c-3546-447a-815e-9376e774eac0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.452224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.452862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.453138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.453403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.467137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:07.469385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.470025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.470358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.470673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] PATH_INFO: `/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.471856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] RBAC: Authorizing `identity:get_user(user_id=3ceac7f6868946d6bc9f50e446ad6ec9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.473354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:07.474786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:07.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:07.477724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:07.478478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 177/353] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/users/3ceac7f6868946d6bc9f50e446ad6ec9 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:07.478584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 177/354] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:07.478651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.484296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.518905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.592786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e3d05-b919-4b6c-82bf-996cdf553081 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.606347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53120a11-a8d9-48cc-a2d9-adc6da33aa1f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.631498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.632108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.632383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.633276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.660981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.661599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.661870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.662136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.662903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:07.663198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.664767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.676422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 178/355] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:07.677611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.678127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.734326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.736344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6528526-8001-459b-9c59-3c39ed15df39 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.793118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:07.810781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd74a5e-9ab0-4084-b509-85675a9f921c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:07.855133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:07.855762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.856035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.856298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.857014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] RBAC: Adding query filter params (role.id=a136b0fbdd82447faf4932746f2c04f8, user.id=3ceac7f6868946d6bc9f50e446ad6ec9, scope.system=all) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:07.857371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:07.858323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 178/356] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:07.859128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813e93-23a5-46aa-b7c1-35295f8eaad1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:07.859601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdacab-db90-47f2-a4a9-7fead8b25c34 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.859886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdacab-db90-47f2-a4a9-7fead8b25c34 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.860158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdacab-db90-47f2-a4a9-7fead8b25c34 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.861630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 179/357] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:07.862338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdacab-db90-47f2-a4a9-7fead8b25c34 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:07.873169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 179/358] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/role_assignments?user.id=3ceac7f6868946d6bc9f50e446ad6ec9&scope.system=all&role.id=a136b0fbdd82447faf4932746f2c04f8 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:07.874703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:07.875182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:07.876188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:07.901763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:07.903481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:07.951684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.000276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 180/359] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:08.001153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.020470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdacab-db90-47f2-a4a9-7fead8b25c34 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.107487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.110314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.110876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.111341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.171515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.208234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.209849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676d367-ca62-4c71-ab35-465c36557661 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.219883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a39f2-54a1-4a7d-bf0e-6cc9d454a248 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.278508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.278508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.278508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.278508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.278898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.278898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11d038-052f-4427-91f5-323676352cd7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.280801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 181/360] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:08.282051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b993-3019-4768-811a-71078d418a1b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.282248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b993-3019-4768-811a-71078d418a1b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.282575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80b993-3019-4768-811a-71078d418a1b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.283809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 182/361] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:08.286162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80b993-3019-4768-811a-71078d418a1b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.306034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.374768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 180/362] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:08.375819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.376097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.376371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.415559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:08.416767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:08.439625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80b993-3019-4768-811a-71078d418a1b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.483955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.484882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.485846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.486301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.487874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.489632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.492420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 183/363] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:08.493630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.498931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 181/364] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:08.499762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.514620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.633193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62b8d8-c65e-4b80-80f0-7d4225ac4ce2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.636039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.645012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435edd-6a63-4ec0-a698-7b96064b1e6f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.685615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.686713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.687214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.687625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.689164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.690563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.691169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.691389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.691811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.692175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.693469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 184/365] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:08.694433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.710430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:08.717115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:08.718155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:08.719079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:08.726571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 182/366] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:08.726571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.799235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:08.831126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00c1a-858a-4697-b471-a8b3bb1de29b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.863261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ee91-1dd5-43e5-9107-33a787558ae9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:08.874215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.875085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.875514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.875963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.876868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=718b4d3572034c75a5cb6b4b423f6743) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:08.877317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.879124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.885995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 185/367] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:08.886990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.917824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:08.918873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:08.919306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:08.919754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:08.922230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:08.924216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:08.927005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 183/368] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:08.928545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:08.960353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.036440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd7c4-6224-4ece-af6c-32dc55e2d199 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.050388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585c932-b77a-4cb8-b765-8571d2a9d326 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.081776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.082567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.082945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.083312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.084170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:09.084568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.086742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.096635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 186/369] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:09.097094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.100182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.101738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.102750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.103187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.103604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.119176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:09.125749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:09.126764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:09.127538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:09.128123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 184/370] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:09.134537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.226085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daee45-01b3-45a7-8a12-9859e56825aa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.231722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.251380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23b1-dfa5-4864-a342-81e01a68740d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.270598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.271370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.271643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.272216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.273010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=a91a89818523427f9295a540fa435066, scope.project.id=79edb0b34aae40ccbbd22ba26110a573) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:09.273887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.275810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.284846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 187/371] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a91a89818523427f9295a540fa435066 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:09.286836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.293186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.293815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.294135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.294415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.375115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.376602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.386842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.466686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db5626-d0d8-428a-9d71-fa08b112ab18 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.537977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.559222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.560224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.560464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 185/372] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:09.560873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.561142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.561804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:09.562100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.565242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.570987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.577847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 188/373] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:09.583620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.725243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e99178-787c-478a-9644-cb91dbd76d95 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.748844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b70-c67a-4146-b6a8-395174f1dfd8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:09.784647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.799057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.800586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.802290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.803374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.805406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:09.808761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:09.809354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:09.809871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:09.812673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.820215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.822574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 186/374] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:09.828163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:09.890878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:09.892868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:09.917643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:09.974580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda35a-c48e-4e9c-97a9-afbcc5750564 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.035079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.035973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.036368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.036752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.038629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:10.040916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878d57c-0a30-4fa2-ad70-3bb9e0fc8da4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:10.043765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 187/375] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:10.049824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ca9c-a983-4550-a673-31726b7b6c9f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.050355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ca9c-a983-4550-a673-31726b7b6c9f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.050847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ca9c-a983-4550-a673-31726b7b6c9f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.050964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 189/376] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:10.051970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:10.053151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 188/377] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:10.057951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ca9c-a983-4550-a673-31726b7b6c9f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:10.095868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:10.202809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833ff7d-c9f4-4a81-adff-67860f182120 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.211679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ca9c-a983-4550-a673-31726b7b6c9f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.242863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:10.247815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.248537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.249357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.249962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.251520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=79edb0b34aae40ccbbd22ba26110a573) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:10.251913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:10.253627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96da3c0-73fe-4674-94f3-54459652c6c9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:10.262332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.262850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 190/378] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:10 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:10.263451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.263907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.264355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] PATH_INFO: `/v3/projects/86142456f2d74608ba47355a3c5212f1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.264462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.264727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.265072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.266104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] RBAC: Authorizing `identity:get_project(project_id=86142456f2d74608ba47355a3c5212f1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:10.267754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:10.269597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 189/379] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:10 2022] GET /identity/v3/projects/86142456f2d74608ba47355a3c5212f1 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:10.280957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:10.303674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:10.304851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:10.463400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 191/380] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:10.493853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fb3af-5635-4008-9f70-00c14d164c5c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.538377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.539740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.540007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.540265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] PATH_INFO: `/v3/groups/9d8c59a92e3f455b9ed6697194d37217` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.547533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] RBAC: Authorizing `identity:get_group(group_id=9d8c59a92e3f455b9ed6697194d37217)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:10.549031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:10.553321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 190/381] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:10 2022] GET /identity/v3/groups/9d8c59a92e3f455b9ed6697194d37217 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:10.557344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:10.587891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:10.696453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebb65e-c7ab-4e3a-8de5-5b0713a16501 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.743190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.743870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.744144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.744409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.745182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] RBAC: Adding query filter params (group.id=9d8c59a92e3f455b9ed6697194d37217, role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=86142456f2d74608ba47355a3c5212f1) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:10.745489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:10.746939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:10.753159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 192/382] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:10 2022] GET /identity/v3/role_assignments?group.id=9d8c59a92e3f455b9ed6697194d37217&scope.project.id=86142456f2d74608ba47355a3c5212f1&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:10.806953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:10.871886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:10.931289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e1013-2f88-4f1d-be61-e30e3dea046e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:10.971127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:10.972140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:10.972618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:10.973106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:10.985538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:10.990968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:10.993629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:10.994420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:10.996744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 191/383] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:11.002872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:11.148951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:11.167197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed622a69-a74f-4ad5-8662-7838e6e3ab53 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:11.205798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:11.206797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.207275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.207762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.208627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:11.209135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:11.210757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:11.220147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 193/384] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:11.225929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:11.341772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e73dd-e0c0-4ebd-96aa-af9cfec5ec7e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:11.362154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:11.389716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:11.391303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.392083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.392661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.393994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:11.395700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9a46-957b-4b38-8f45-e90e6f35f876 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:11.397839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 192/385] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:11 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:11.403648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:11.443063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee344-85ac-48fb-a300-877b1a2b425c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.443927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee344-85ac-48fb-a300-877b1a2b425c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.444408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefee344-85ac-48fb-a300-877b1a2b425c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.446838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 193/386] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:11.452717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.453595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.454071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.481456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:11.483539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:11.552660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eca94d-eb49-480b-849b-f2029f289961 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:11.586600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:11.587325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.587504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.587777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.588907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:11.590338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:11.592506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 194/387] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:11 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:11.598850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:11.606251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 194/388] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:11.629278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:11.740316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554ff9-177f-488e-b66c-c483178d2387 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:11.788559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:11.789859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:11.790129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:11.790395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/groups/40638bc104be4e3380cb98489fa62d79/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:11.795763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, group_id=40638bc104be4e3380cb98489fa62d79, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:11.797211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d881141-2930-4dff-8e5d-d2a1f1d8a62e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:11.814726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 195/389] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Sep 19 16:00:11 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/groups/40638bc104be4e3380cb98489fa62d79/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:00:12.075351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:12.192257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421766-9f38-44a8-bda7-359d7cd52bfd None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.192961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421766-9f38-44a8-bda7-359d7cd52bfd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.193444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421766-9f38-44a8-bda7-359d7cd52bfd None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.197846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 196/390] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:12.204038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.204677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.205183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.208240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857271-f24b-4f12-aa8c-831183be8b55 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:12.223653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:12.225636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:12.227216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:12.275822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:12.277453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.278127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.279156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.302402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:12.310584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:12.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:12.312264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:12.317085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 195/391] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:12.322386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:12.364683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 197/392] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:12.473331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1c838-1caf-4f09-a068-9137adcfe838 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:12.520078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:12.520945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.521364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.521818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.522656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:12.523130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:12.524633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:12.538267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 196/393] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:12.543506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:12.555364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:12.671660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d54cf-3549-4e2a-8a34-13228386fb8b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:12.717087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:12.717771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.718002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.718270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.719388 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:12.720821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:12.722685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 198/394] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:12 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:12.727919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:12.792308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:12.874698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889793c-5c38-4373-9820-7f7c06044e55 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:12.916439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:12.917458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:12.917934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:12.918412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:12.923235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:12.924911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:12.927379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 197/395] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:12 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:12.933272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:12.939619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:13.086962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:13.119772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:13.123892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681a19-af14-4916-99c7-df03b1d3ded0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.133646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c088-f948-46f5-884b-abdbee2836b4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.186064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.186635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.186911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.187182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.193926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.194609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.194916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.195188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743/groups/40638bc104be4e3380cb98489fa62d79/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.198818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=718b4d3572034c75a5cb6b4b423f6743, group_id=40638bc104be4e3380cb98489fa62d79, role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:13.201436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:13.208018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:13.214613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:13.215502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:13.216357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:13.216959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 198/396] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:13.227798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:13.230622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 199/397] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Sep 19 16:00:12 2022] PUT /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743/groups/40638bc104be4e3380cb98489fa62d79/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:13.376494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179ffc-da96-4d3e-8fa6-8bde6b1b4ae1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.420657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.421291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.421567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.421837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.422550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:13.422854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:13.424363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030df4f-ce0f-4df5-aa7c-00dbbc163e23 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:13.436199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 199/398] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:13.441166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:13.551519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda65d4-92a2-442c-83b7-8e14393cfd40 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.552415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda65d4-92a2-442c-83b7-8e14393cfd40 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.552910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda65d4-92a2-442c-83b7-8e14393cfd40 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.554463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 200/399] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:13.559936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.560475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.560947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.564671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115c3b-d3ae-4c39-ada3-ac141bfd51a3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.582607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:13.584171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:13.603346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:13.606427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.607279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.610405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.610867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.612947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:13.614375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:13.615972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 200/400] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:13 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:13.622039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:13.628470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:13.707745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 201/401] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:13.762060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcd121-f863-420b-8c13-3df04d441f97 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.797528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.798154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.798424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.798721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.799834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:13.801265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:13.803466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 201/402] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:13 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:13.808794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:13.935049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349f99b-8760-4d11-b690-84938393a8c7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:13.971711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:13.972288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:13.972560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:13.972824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/groups/40638bc104be4e3380cb98489fa62d79/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:13.974785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, group_id=40638bc104be4e3380cb98489fa62d79, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:13.976591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2892a0-447d-419c-892a-345f4ce06c3b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:13.991271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 202/403] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Sep 19 16:00:13 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/groups/40638bc104be4e3380cb98489fa62d79/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:00:14.087855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.156142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232e34-e618-49b9-a1bc-6016010b1de8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.156806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232e34-e618-49b9-a1bc-6016010b1de8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.157277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5232e34-e618-49b9-a1bc-6016010b1de8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.162594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 203/404] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:14.175045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.175654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.176142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.202898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:14.215838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:14.217421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:14.225736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:14.229984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c251-f1d0-4421-b273-46a775d07354 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:14.272566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:14.273712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.274227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.274739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.289587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:14.295772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:14.296715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:14.297476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:14.300107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 202/405] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:14.311335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.312658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 204/406] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:14.428091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25766531-28a6-4351-adc0-7a1081115710 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:14.466634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:14.473341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:14.473941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.474213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.474550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.475265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:14.475610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:14.477556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a78dfc-e31b-4676-a1ab-d9b79e5a9964 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:14.490164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 203/407] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:14.496691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.514271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaad5-e4c9-4c62-b20b-80cdc068c877 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.514671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaad5-e4c9-4c62-b20b-80cdc068c877 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.514956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaad5-e4c9-4c62-b20b-80cdc068c877 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.516510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 204/408] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:14.521468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.521588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.521835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.540654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:14.541890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:14.622574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 205/409] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:14.652249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640256ec-af32-4ec2-be73-992b9bc15112 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:14.656460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.689143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:14.689768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.690037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.690302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.691462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:14.692908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:14.694864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 205/410] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:14.703570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.725536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:14.764375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251c738-1bc3-4bf2-b3e0-f529919f1348 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:14.791382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:14.804503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:14.805176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.805455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.805725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.817217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:14.823290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:14.824174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:14.825444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 206/411] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:14.834372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:14.894703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27a1c-b448-4adb-bccc-07f6d3d7cdce None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:14.962668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:14.963316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:14.963587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:14.963851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:14.965000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:14.966433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:14.968505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 206/412] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:14.974221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.011507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb5c7-357b-4efb-aa6d-5703691a27e2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.047778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.048387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.048658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.048923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.049566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:15.049922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.051329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.060677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 207/413] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:15.061486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.076891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.108479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f215d-9850-4968-ab44-a536ad8fef19 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.117688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.155536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.156462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.156756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.157462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573/groups/40638bc104be4e3380cb98489fa62d79/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.160083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=79edb0b34aae40ccbbd22ba26110a573, group_id=40638bc104be4e3380cb98489fa62d79, role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.161890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.177035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984e5e-fd7f-44ab-b640-f0ae14bcb303 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.188667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 207/414] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Sep 19 16:00:14 2022] PUT /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573/groups/40638bc104be4e3380cb98489fa62d79/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:15.189494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.247249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.247910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.248184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.248453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.272214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:15.278268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:15.280043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:15.282048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 208/415] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:15.286535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.387895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aefed-75a4-4f07-9bfc-c5f05feac0b0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.433782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.434406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.434706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.434975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] PATH_INFO: `/v3/groups/9d8c59a92e3f455b9ed6697194d37217` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.436152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] RBAC: Authorizing `identity:get_group(group_id=9d8c59a92e3f455b9ed6697194d37217)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.437552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.439127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 208/416] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:15 2022] GET /identity/v3/groups/9d8c59a92e3f455b9ed6697194d37217 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:15.444499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.453530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.460021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfe393-0254-460d-8b06-3406692b4470 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.469835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.501310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.501928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.502235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.502546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.503350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:15.503657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.505042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.516172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 209/417] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:15.525949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.556431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08b25-a6fe-4e28-9841-c895e5cef501 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.597597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.598222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.598519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.598779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] PATH_INFO: `/v3/projects/86142456f2d74608ba47355a3c5212f1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.600077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] RBAC: Authorizing `identity:get_project(project_id=86142456f2d74608ba47355a3c5212f1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.601547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.604803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 209/418] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:15 2022] GET /identity/v3/projects/86142456f2d74608ba47355a3c5212f1 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:15.611526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:15.711414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd550a2-b87d-4204-87ea-cf38ecec7272 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.748523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.767334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2558bc-37b1-4426-bd58-f6c9fbebbb81 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:15.795234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.795910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.796133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.796406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.803919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:15.804849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.805196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.805410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] PATH_INFO: `/v3/projects/86142456f2d74608ba47355a3c5212f1/groups/9d8c59a92e3f455b9ed6697194d37217/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.807431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] RBAC: Authorizing `identity:create_grant(project_id=86142456f2d74608ba47355a3c5212f1, group_id=9d8c59a92e3f455b9ed6697194d37217, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.808999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e718-e5f8-40ac-9da5-40840f368345 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.841047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 210/419] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Sep 19 16:00:15 2022] PUT /identity/v3/projects/86142456f2d74608ba47355a3c5212f1/groups/9d8c59a92e3f455b9ed6697194d37217/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:15.854885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:15.903171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:15.905042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:15.974513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697c67-a031-44c5-adf5-5c129398828b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.975035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697c67-a031-44c5-adf5-5c129398828b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.975109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19697c67-a031-44c5-adf5-5c129398828b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:15.977390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 211/420] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:15.983693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:15.983980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:15.984250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.006276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:16.008888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:16.081733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 210/421] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:16.088310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:16.103090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 212/422] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:16.214275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:16.252423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5bf3-ab43-4aeb-ac18-e76d1f5f81c7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:16.293408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:16.294036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.294305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.294607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.295715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:16.297150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:16.299009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 211/423] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:16 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:16.305408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:16.373743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:16.414731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e60a9-3d93-4aad-8754-db8aeb966268 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:16.451791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:16.467951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:16.468511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.469039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.469315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.470925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:16.472992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:16.480215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 213/424] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:16 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:16.485759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:16.667268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b254a-2daa-4bdf-9806-8effc7ec556b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:16.678461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb58c1d-5deb-45b8-8a02-02c9fddc952a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:16.699056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:16.711706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:16.712321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.712590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.712853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.713572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=a91a89818523427f9295a540fa435066, scope.project.id=718b4d3572034c75a5cb6b4b423f6743) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:16.713874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:16.716040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7190e-6458-470b-8492-21ccc708b1d4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:16.733106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:16 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=a91a89818523427f9295a540fa435066 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:16.738151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:16.738847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.739117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.739385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.742670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:16.749871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae5a1-1d02-4432-b437-acf433305c01 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.750518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae5a1-1d02-4432-b437-acf433305c01 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.751022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae5a1-1d02-4432-b437-acf433305c01 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.752640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 215/426] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:16.756836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:16.759156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.759680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:16.759786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:16.760610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:16.761417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 212/427] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:16.762625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.771615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:16.808584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:16.811009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:16.939956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 216/428] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:16.957575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1e4c2-9099-40ce-8e5f-2a4464b486dd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:16.994820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:16.995645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:16.996058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:16.996462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:16.997252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:16.997705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:16.999286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.008333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 213/429] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:17.013970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.120153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbc199-c4b4-4fdf-a43f-6f35fb0375dc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.146221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.156035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.156642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.157316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.157581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.230098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.231599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.253354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.336559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.340664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 217/430] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:17.345503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.374258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.394448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0c674-d31c-410f-91a8-e6280f044767 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.437007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.437642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.437913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.438178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.449321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:17.451341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24cfce-14db-45c1-a1d9-96ebed18f1c4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:17.459594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:17.461068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:17.461894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 214/431] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:17.475496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.490548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.491508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.492219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.492708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] PATH_INFO: `/v3/projects/718b4d3572034c75a5cb6b4b423f6743` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.494060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] RBAC: Authorizing `identity:get_project(project_id=718b4d3572034c75a5cb6b4b423f6743)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.495728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.497836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 218/432] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/projects/718b4d3572034c75a5cb6b4b423f6743 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:17.503000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.610104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.619754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede34-b193-4e85-ae11-e0610f767a36 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.631822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850fbf-6b91-4537-96de-25171482f7d0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.655018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.662095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.663088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.663598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.664062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.665387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.667051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.669115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 219/433] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:17.674758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.680760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.681676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.682129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.682637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.683498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:17.683980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.685714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.696905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 215/434] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:17.703704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:17.808938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b73ec2-3ca2-44db-bf1f-dc481a377dbf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.836845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29737a3-a4be-4a4f-b739-753c62486a16 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:17.850575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.851484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.851939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.852205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.852915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=718b4d3572034c75a5cb6b4b423f6743) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:17.853217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.854966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45ff46-93ed-4bcd-b7ce-a46e8584dfb8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.860973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 220/435] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=718b4d3572034c75a5cb6b4b423f6743&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:17.862036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35732-6b61-4025-9b74-ccb5923931fd None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.862314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35732-6b61-4025-9b74-ccb5923931fd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.862790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35732-6b61-4025-9b74-ccb5923931fd None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.863853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 221/436] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:17.874168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:17.875168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.875640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.876075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.876421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:17.876803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:17.877183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:17.898111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:17.899451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:17.923500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.935853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:17.959187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:17.961595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:17.986281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 222/437] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:18.072973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 216/438] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:18.078786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.188757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa45c5-dba8-4d05-89bd-760730f9bd75 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.224898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.225482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.225756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.226601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.227725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:18.229160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:18.230945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 223/439] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:18.236398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.270459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.301726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:18.342308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:18.367477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38ef6-73d5-43a5-beef-397db3ff99cd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.412083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.412733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.413008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.413105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f1f3-e93e-4feb-838d-f37a3975a3f8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.413282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.415047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:18.416598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:18.418431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 217/440] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:18.424335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.454240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.454818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.455093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.455364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.466127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:18.470983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:18.471845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:18.472607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 224/441] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:18.478338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.534619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b439-b26b-40fa-a4b3-ca42dfa2b5ce None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.564844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:18.570540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.571171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.571451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.571713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.572452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=a91a89818523427f9295a540fa435066, scope.project.id=79edb0b34aae40ccbbd22ba26110a573) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:18.572751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:18.574157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b733e-50ab-4982-8546-a304fd2024e8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:18.580332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 218/442] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=a91a89818523427f9295a540fa435066 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:18.580563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5333-54d9-4a89-8e67-b3e20f8877ee None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.581768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fc048-db93-47ee-905b-aff358798a5a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.582200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fc048-db93-47ee-905b-aff358798a5a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.582469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fc048-db93-47ee-905b-aff358798a5a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.583865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 219/443] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:18.590156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.590431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.590735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.612189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:18.613439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:18.622509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:18.622747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.623173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.623439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.623708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.624746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:18.625049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:18.626639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:18.640562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 225/444] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:18.642186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.697035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 220/445] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:18.749149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3d76-7051-4e7f-bdca-791cee3ce1ef None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:18.784250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:18.784852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:18.785127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:18.785395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:18.800574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:18.857377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:18.858866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:18.963343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:18.969533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 226/446] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:18.975741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.022750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.068715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0a903-72ed-4755-9c2c-ea8a84368d39 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.074417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609559-6dcd-48e0-80a7-fe17dcc14884 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.102822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.103448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.103723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.103992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.106973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.107594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.107869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.108139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] PATH_INFO: `/v3/projects/79edb0b34aae40ccbbd22ba26110a573` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.109234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] RBAC: Authorizing `identity:get_project(project_id=79edb0b34aae40ccbbd22ba26110a573)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.110725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.112320 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 227/447] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/projects/79edb0b34aae40ccbbd22ba26110a573 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:19.113975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:19.117690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:19.118898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:19.119928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:19.120753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 221/448] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:19.125332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.128424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.221038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c9a1-93f3-402a-8a20-9529311b0a6f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.232449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75735ec5-eb6a-4c79-81a4-d0f06959e0d2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.234697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.255520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.256417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.256693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.256963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] PATH_INFO: `/v3/groups/40638bc104be4e3380cb98489fa62d79` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.258691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] RBAC: Authorizing `identity:get_group(group_id=40638bc104be4e3380cb98489fa62d79)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.260127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.261666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 228/449] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/groups/40638bc104be4e3380cb98489fa62d79 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:19.267220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.267480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.267829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.268108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.268384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.269035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:19.269336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.271700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.280333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 222/450] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:19.285762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.346981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.368306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bff5f-8119-4824-b981-3a6362a867d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.386741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afd86b-193f-4429-9596-23d4a75661f0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.401993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.402624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.402903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.403177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.403893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] RBAC: Adding query filter params (group.id=40638bc104be4e3380cb98489fa62d79, role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=79edb0b34aae40ccbbd22ba26110a573) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:19.404208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.405648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.411853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 229/451] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/role_assignments?group.id=40638bc104be4e3380cb98489fa62d79&scope.project.id=79edb0b34aae40ccbbd22ba26110a573&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:19.420749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.421369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.421640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.421906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.497065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.498557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.563482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.603677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 223/452] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:19.609461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.657491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:19.711399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268fddf-c424-4ed6-aa0c-0b49246cfb11 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.745709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.746336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.746682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.746955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] PATH_INFO: `/v3/projects/86142456f2d74608ba47355a3c5212f1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.748062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=86142456f2d74608ba47355a3c5212f1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.749487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.751130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 230/453] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/projects/86142456f2d74608ba47355a3c5212f1 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:19.756815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.853802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35128-fad5-4260-b20e-a179db74fec3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:19.886339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:19.886976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:19.887247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:19.887513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] PATH_INFO: `/v3/groups/9d8c59a92e3f455b9ed6697194d37217` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:19.888591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] RBAC: Authorizing `identity:get_group(group_id=9d8c59a92e3f455b9ed6697194d37217)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:19.890000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4290e-1b28-43f1-ad34-18e1077e513c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:19.891562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 224/454] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/groups/9d8c59a92e3f455b9ed6697194d37217 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:19.897886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:19.993708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c015c1-1ab5-44e1-bc3d-0d7cd6e67cb1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:20.006963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:20.026873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:20.027455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:20.027728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:20.027997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:20.028698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] RBAC: Adding query filter params (group.id=9d8c59a92e3f455b9ed6697194d37217, role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=86142456f2d74608ba47355a3c5212f1) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:20.029001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:20.030412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d91dd-1e4c-4362-bdbf-6e1e57f24da7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:20.035964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 231/455] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Sep 19 16:00:19 2022] GET /identity/v3/role_assignments?group.id=9d8c59a92e3f455b9ed6697194d37217&scope.project.id=86142456f2d74608ba47355a3c5212f1&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:22.532814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a851a4-c355-4aa2-86ca-e027de2899f9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:22.533821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a851a4-c355-4aa2-86ca-e027de2899f9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:22.534326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a851a4-c355-4aa2-86ca-e027de2899f9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:22.536377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 225/456] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:22.542170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c081c2-beb2-4829-8341-e75ed463ff18 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:22.543014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c081c2-beb2-4829-8341-e75ed463ff18 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:22.543484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c081c2-beb2-4829-8341-e75ed463ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:22.571439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-56c081c2-beb2-4829-8341-e75ed463ff18 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:22.572987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-56c081c2-beb2-4829-8341-e75ed463ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:22.661205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 232/457] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:22.840557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2de9-d18a-4146-a5ea-1c602ed5d065 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:22.841230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2de9-d18a-4146-a5ea-1c602ed5d065 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:22.841733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2de9-d18a-4146-a5ea-1c602ed5d065 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:22.843532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 226/458] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:22.849463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b7ff-2fc4-4ba6-858b-157001a0ee2f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:22.850017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b7ff-2fc4-4ba6-858b-157001a0ee2f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:22.850577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b7ff-2fc4-4ba6-858b-157001a0ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:22.879428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4cd8b7ff-2fc4-4ba6-858b-157001a0ee2f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:22.881077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4cd8b7ff-2fc4-4ba6-858b-157001a0ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:22.964245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 233/459] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:23.072012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2de9-d18a-4146-a5ea-1c602ed5d065 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.104575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.144446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d187-597a-42b1-876a-d51f5896a817 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.144724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d187-597a-42b1-876a-d51f5896a817 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.145225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d187-597a-42b1-876a-d51f5896a817 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.147012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 234/460] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:23.152120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.152625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.153005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.188493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:23.190693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:23.214650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2de9-d18a-4146-a5ea-1c602ed5d065 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.250852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.267777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.268646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.269066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.269506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.280805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.283235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.293295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 235/461] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:23.294506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:23.323580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:23.324629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:23.325483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:23.325483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.325483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:23.333594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 227/462] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:23.348191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.464171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.491756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f18d84-52ca-436f-97b4-27873e922c23 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.496189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe901-fa9b-40a7-a1f5-b7e2fea23d84 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.530591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.531390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.531832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.532051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.532252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.532995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.533159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:23.533594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.533785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.534155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.535821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c376-0aa7-4f62-bbc8-c18818156f24 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.544353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.546463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.554259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 228/463] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:23.555731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690b47-647f-410d-982d-c05b7604ba6d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.556152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690b47-647f-410d-982d-c05b7604ba6d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.556560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690b47-647f-410d-982d-c05b7604ba6d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.558189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 229/464] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:23.559029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73690b47-647f-410d-982d-c05b7604ba6d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d393c950-fcad-413c-a148-e0524577bc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:23.564022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:23.564992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:23.565803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:23.565803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.565803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:23.565803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:23.567302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.567675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.568042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.587581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:23.588761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:23.603411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.662391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 237/466] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:23.663649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.685456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73690b47-647f-410d-982d-c05b7604ba6d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.726194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.727347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.727821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.728586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.729650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.731908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.755257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.762611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 230/467] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:23 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:23.763819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.783263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf228de5-218b-4296-973c-f9299d56acd9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.825049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.825952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.826362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.826799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.827753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:23.828157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.829684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.843563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 238/468] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:23.849489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:23.865378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:23.912995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cecc96-6336-4644-84e1-20af00662577 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:23.956311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:23.957225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:23.957647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:23.958058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:23.972080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:23.974354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:23.992951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:23.993927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:23.994796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:23.994796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:23.994796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:23.997591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 231/469] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:24.006099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.037402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e492aec-65e0-46e5-ab99-bd5e064902a1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.078055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.079323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.079323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.079323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.080069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.080559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:24.081338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.107800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 239/470] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:23 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:24.107800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.164403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6c0f-9754-4107-8218-0a1adad1e457 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.214379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.215165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.215516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.215859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.219418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:24.231590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.233545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.252813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692b144-0840-4152-bebe-526ce8d28ab6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:24.256407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:24.257356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:24.258437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:24.258437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:24.258437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:24.258437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 232/471] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:24.266076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.296989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.297988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.298551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.299001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.299843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:24.300329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.302012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b2af-dfef-4030-ab87-a756eaa2ef92 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.318568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 240/472] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:24.320391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680a2d-51f6-4746-a700-1408dc8cf373 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.320669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680a2d-51f6-4746-a700-1408dc8cf373 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.320938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7680a2d-51f6-4746-a700-1408dc8cf373 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.329736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 241/473] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:24.329736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680a2d-51f6-4746-a700-1408dc8cf373 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.410634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e522cc-b198-4e49-b24c-6a7c7e1935cb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.413824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:24.452616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.453220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.453490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.453754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.454389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:24.454715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.456160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ccc3-7a5e-4d76-b0d7-d7eead10f47e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.463021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7680a2d-51f6-4746-a700-1408dc8cf373 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.469256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 233/474] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:24.470276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.470586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.470857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.492885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:24.495026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:24.500887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:24.510399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.511264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.511469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.511829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.512652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.514228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.540673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 242/475] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:24 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:24.541715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.585757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 234/476] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:24.671838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675636-1c20-4d36-b711-a34cb3eb9d16 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:24.711282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:24.712279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:24.712750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:24.713229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:24.714148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:24.715890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:24.743507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 243/477] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:24 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:24.880210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:24.988746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:24.997595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e851b7-a21c-40a7-b03f-6b14906827c7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:25.032706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:25.033310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:25.033584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:25.033845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:25.034565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:25.036042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:25.045560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.sql.core [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:00:25.045560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 16:00:25.045560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [parameters: {'id': 'c8ad5ff9a315414283e8c656470eae6d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 16:00:25.045560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81559) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Sep 19 16:00:25.063441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:00:25.064354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application yield resource Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise self.value Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application session.commit() Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:00:25.065240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:00:25.066069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:00:25.067015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:00:25.068556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [parameters: {'id': 'c8ad5ff9a315414283e8c656470eae6d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:25.069341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 16:00:25.070170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:25.073127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 235/478] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Sep 19 16:00:24 2022] POST /identity/v3/roles => generated 144 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:25.073261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:25.117059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:25.192445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b988a-365f-4049-b437-5515333c38bd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:25.229849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:25.230910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:25.231327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:25.231735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:25.246034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5a4ec408-3bef-4318-90f9-a10a8ed5ab47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:25.251763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:25.252802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:00:25.253828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:25.256042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 244/479] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:25.262352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:25.407115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa7a3-c8bc-49e4-aa3e-3e826aeb4efa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:25.473847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:25.474390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:25.474697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:25.474965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:25.475636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:25.476490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:25.478530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09f61d-73b7-4144-b2cf-ae1d10db3fc9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:25.494650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 236/480] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:26.765358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9b087-0284-4385-b4bc-f6a0922201e3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:26.766330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9b087-0284-4385-b4bc-f6a0922201e3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:26.766855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9b087-0284-4385-b4bc-f6a0922201e3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:26.768669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 245/481] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:26.774010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c2fb-5a09-4424-ae86-9c6164a3ce30 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:26.774829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c2fb-5a09-4424-ae86-9c6164a3ce30 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:26.775299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5c2fb-5a09-4424-ae86-9c6164a3ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:26.779667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99301f-44c4-489a-9a48-dee35d8d0885 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:26.780521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99301f-44c4-489a-9a48-dee35d8d0885 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:26.780981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99301f-44c4-489a-9a48-dee35d8d0885 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:26.784268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 246/482] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:26.795058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:26.795656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:26.796231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:26.815189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3e5c2fb-5a09-4424-ae86-9c6164a3ce30 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:26.816666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3e5c2fb-5a09-4424-ae86-9c6164a3ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:26.825703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:26.827225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:26.851964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:26.938851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 247/483] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:26.953864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 237/484] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:27.255755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.285625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:27.345395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcd9f-b17f-4d3a-8ab6-365a08ebeb8e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.345732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcd9f-b17f-4d3a-8ab6-365a08ebeb8e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.345931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcd9f-b17f-4d3a-8ab6-365a08ebeb8e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.347265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 238/485] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:27.352100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.352369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.352633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.376691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:27.378268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:27.393446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8687a-a20b-49d0-a3fe-11c211e78b0c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:27.438025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:27.439045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.439515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.439975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.451562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:27.456676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:27.457519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:27.458306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:27.460830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 248/486] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:27.462388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.477176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 239/487] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:27.478088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.563748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:27.587202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:27.588853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb4d0-c0cc-4d7f-aba7-92110b1cc303 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:27.604108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a0de-633b-4d35-9b89-198b9b6be18e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:27.629751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:27.630779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.631280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.631751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.633183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:27.633773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:27.635368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c4b53-1974-4c70-80a4-95566b100230 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:27.644833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 240/488] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:27.646381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe264-03a1-41cf-aab1-5e0e3eb7a307 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.646876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe264-03a1-41cf-aab1-5e0e3eb7a307 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.647335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe264-03a1-41cf-aab1-5e0e3eb7a307 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.649161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 241/489] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:27.650094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abe264-03a1-41cf-aab1-5e0e3eb7a307 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.653664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:27.654308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.654616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.654894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.668840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e28035ad-2e1d-4f70-a2f5-0f9eb77df4d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:27.673717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:27.674651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:27.675427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 249/490] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:27.676555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209805e2-12bc-4508-a3ad-137245420558 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.682004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209805e2-12bc-4508-a3ad-137245420558 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.682326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209805e2-12bc-4508-a3ad-137245420558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.701167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-209805e2-12bc-4508-a3ad-137245420558 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:27.702429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-209805e2-12bc-4508-a3ad-137245420558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:27.774621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 250/491] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:27.775507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209805e2-12bc-4508-a3ad-137245420558 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.793695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abe264-03a1-41cf-aab1-5e0e3eb7a307 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:27.841038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:27.842194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.843078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.843844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.858616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:27.860298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:27.862983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:27.871302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:27.883550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:27.884449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:27.885331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:27.885331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:27.885331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:27.887754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 242/492] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:27.888780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:27.893142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209805e2-12bc-4508-a3ad-137245420558 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:27.929783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:27.930559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:27.931015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:27.931381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:27.932247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:27.932640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:27.934109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:27.948621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 251/493] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:27.949705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.021599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545efff3-6af5-4ff6-9212-17ca63e12732 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.058043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.058695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.058967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.059233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.070380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc2a99-9b3a-4bb1-89b3-908cd9153499 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.071137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:28.076369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.077256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:28.078048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 243/494] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.078731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.112002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.112528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.112782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.113054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.113676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:28.113968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.115357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.124714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.129270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 252/495] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:28.130072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.144053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.196174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653772e-f486-48f7-8eb0-5385ef5917ea None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.231702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.232423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.232694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.232960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.237952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a2203-0f84-4524-a6b3-15c188bdf0b3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.245151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.246657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:28.261486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.262400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:28.263256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:28.263256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.263256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:28.263256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 244/496] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.263475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.280408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.280974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.281246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.281512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.292108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:28.297334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.298240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 253/497] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.299351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.366229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.386390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f6ce8-d81a-4c98-99f2-cd4dbab99192 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.394006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.410906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534719b-356e-41b9-a617-86067adc79cd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.426081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.426840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.427369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.427641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.428309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:28.428606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.430719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.440660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 245/498] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:28.441514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.453306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.454003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.454288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.454595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.463342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.464831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:28.477659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.478602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 254/499] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.479501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.552731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53a914-876a-40cc-ac65-a7676c1f2596 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.578387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593440aa-105d-435e-af6c-c559ad625027 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.585959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.586779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.587058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.587326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.587958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:28.588252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.589626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.597429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.602735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 246/500] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:28.603531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.612093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.612688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.612958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.613224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.613874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:28.614168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.615575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.623974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 255/501] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:28.624684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.635658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.705445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9b39d-571c-47f4-a796-c78a2402109d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.721583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16424af-8dc4-41b0-98f3-4ea0052c7f1a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.741294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.742451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.742748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.743011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.752770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.754212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.755528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.756124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.756423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.756709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.757461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:28.757765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.759202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9e96e646-965c-47d2-a12d-507659b678fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:28.768843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.769735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:28.770595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:28.770595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.770595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:28.770595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 247/502] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.771074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f518-4b2a-4935-99af-db1fc640df1b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.771343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f518-4b2a-4935-99af-db1fc640df1b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.771592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f518-4b2a-4935-99af-db1fc640df1b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.772796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 248/503] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:28.773467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77f518-4b2a-4935-99af-db1fc640df1b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.800046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 256/504] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:28.800983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.841785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.859492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:28.880699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77f518-4b2a-4935-99af-db1fc640df1b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.897995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8ccb2-ace3-4e08-8dc5-e0aa957e2386 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:28.915790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.916408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.916683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.916952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.924289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.925729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.931721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:28.932341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.932616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.932886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:28.938982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.940051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 249/505] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.941025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:28.946029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:28.947612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-8844f95a-938c-4b59-b998-3c71a501df56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:28.962807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:28.963691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:28.964512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:28.964512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:28.964512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:28.964512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 257/506] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:28.965130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea890-d202-4964-a006-88d834bc5204 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:28.965410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea890-d202-4964-a006-88d834bc5204 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:28.965680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea890-d202-4964-a006-88d834bc5204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:28.983683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-753ea890-d202-4964-a006-88d834bc5204 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:28.984866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-753ea890-d202-4964-a006-88d834bc5204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:29.043510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37d7ea-2cf1-487d-bf08-feba6015ea74 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.049309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 258/507] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:29.050137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ea890-d202-4964-a006-88d834bc5204 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.073349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.087908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.088510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.088780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.089046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.089679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:29.089970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.091378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.101917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.109555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 250/508] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:29.109555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.158388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ea890-d202-4964-a006-88d834bc5204 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.193415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.194012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.194700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.194967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.218954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122216b-3aed-4ea7-8fb3-670766dc3c34 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.263627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.264272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.264490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.264754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.265457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:29.265753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.267196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.270337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.271909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.296818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.309124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 251/509] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:29.309124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.367661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.380504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 259/510] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:29.381338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.410988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78da18-a01b-4899-8554-797e74c02cd0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.445066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.445660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.445929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.446194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.446925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:29.447217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.448587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.459724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 252/511] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:29.461056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.476881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e66d-04c6-4a5c-954d-044bf4d6bb46 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.498971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.512827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.513449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.513722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.513989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.522155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.524476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:29.536269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:29.537210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:29.538127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 260/512] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:29.538727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.578383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d961f-0b77-4d8a-8635-98a39885b566 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.595688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.612856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.613450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.613722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.613990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.640978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32e9b-80a8-4b01-99e3-04dbd3a54a75 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.673114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.673657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.673927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.674196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.684037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.685081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.686532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:29.700763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:29.701659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:29.702519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:29.702519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:29.702519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:29.702519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 261/513] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:29.702731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.736092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.790498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 253/514] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:29.791612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.800854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc86d1-ec41-42eb-922b-8467ddcb8c85 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.809797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.834829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.835985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.836266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.836540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.846738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.848193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:29.862330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:29.863270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:29.864093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:29.864093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:29.864093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:29.864715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 262/515] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:29.865438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.889697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f3ab-4760-41b8-84aa-3c11980ca99b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:29.923391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:29.923941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:29.924214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:29.924484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] PATH_INFO: `/v3/users/glance` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:29.931527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:29.932977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:29.944944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:29.945851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 254/516] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:29.946822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:29.952441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:29.967798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821f32-cd08-495d-8857-3500b7b2b8ae None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.000976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.001575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.001850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.002121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.002886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:30.003247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.004841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.021940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 263/517] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:30.023282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.029079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.051088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11591-e554-4859-b36a-8c40364ddcef None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.083982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.084573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.084843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.085705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.086324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:30.086652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.088001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.099635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 255/518] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:30.100412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.121842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731f8c-241d-457a-bb01-a6cb04f7de9f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.158148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.158824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.159102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.159366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.168984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.170422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.172876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:30.185637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:30.186597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:30.187448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:30.187448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:30.187448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:30.187448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 264/519] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:30.192001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.203883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ee6c-0573-4eeb-81a0-4ec078eaad2e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.237833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.238428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.238731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.239001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.239627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:30.239923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.241332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.247637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.253256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 256/520] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:30.254034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.290995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b12c-113e-420f-a740-4d20126743b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.324203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.324796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.325069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.325335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.326048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:30.326347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.327856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.346636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 265/521] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:30.347423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.355943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b680-fede-4177-a278-3f4fc8ff2105 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.390687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.391285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.391563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.391833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.403436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.447724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6c50-f4dc-46b7-8901-74f13404f54e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.458291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.463006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.464478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.480867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.481466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.481739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.482008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.482664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.484088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.504881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 266/522] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:30 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:30.505666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.586681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 257/523] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:30.587767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.618825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df0ff-0f76-4afb-aae1-267d06653a75 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.629925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.658195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.659158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.659590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.659859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.660509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:30.660805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.662230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.677886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 267/524] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:30.678278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.706779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.712302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc686d-67db-4d9d-8cb9-3f8256ceb679 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.755682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.756295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.756574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.756891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.763888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.765581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:30.777903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:30.778811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:30.779727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:30.781251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 258/525] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:30.781757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.795469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b8fe-a1f5-489f-a9c9-b024d468b832 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.831851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.832500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.832707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.832991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.872362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:30.894876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf61247-8952-45e5-ae67-7aaa988b3339 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:30.903716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.905559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.931582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:30.932321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:30.932599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:30.932874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:30.944051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:30.946156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:30.962207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:30.963361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:30.964285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:30.964285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:30.964285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:30.964285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 259/526] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:30.964285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:30.980910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.017529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 268/527] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:31.017529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.075004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c659-8af1-40f1-b578-ca386f7a8bf7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.092974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.109725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.110444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.110804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.111146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.117885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.119364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.126835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe493-97c1-4461-a4c1-85f0f7ed72ac None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:31.130585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:31.131445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:31.132858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 260/528] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:31.133753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.166019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.166976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.167435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.167886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.168806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.169292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.170968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.198630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 269/529] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.199912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.217151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.251527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ba717-a4ff-46f1-ab87-ad7951f91441 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.288098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.288705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.288985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.289276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.289890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.290180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.291681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.307866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cfa54-ac92-4f3d-9eb2-ff443f2d8a94 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.309336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 261/530] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.310193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.340041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.347466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.347978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.348282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.348529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.361074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.362660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:31.379081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:31.380140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:31.381168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:31.381168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:31.381168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:31.381168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 270/531] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:31.381426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.425921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57ed4e-16ae-4406-b699-88bdef752ca9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.458418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.465096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.465692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.466345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.466659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.467721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.467982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.469569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.488598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7bf5-22c7-41ee-9799-a1ffbcddead1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.494793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 262/532] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.496137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.524490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.525227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.525508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.525777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.526507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=51a2f331dfa2463a9af3282f8d9569e2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.526814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.528271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.534268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 271/533] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/role_assignments?user.id=51a2f331dfa2463a9af3282f8d9569e2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.535319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.588179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.641523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8cb9d-9d13-4113-a0ad-369feb7fa47e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.656725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae625d6-c894-4a67-be31-8404689ace5b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.695640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.696563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.696843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.697113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.701292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.702238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.702763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.703236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.704224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.704742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.704854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.706300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.706687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.720736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 272/534] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:31.721574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:31.722401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:31.723276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 263/535] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:31.724650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.731026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.793421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.852493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7f6c3-5e60-4297-ab61-b0c3aad4a93a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.854507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246ed9-892d-4992-a61b-54291804e741 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:31.861341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:31.895873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.897151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.897815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.897953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:31.898528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.898730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:31.899012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:31.899284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:31.900099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.900677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.902294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.903806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:31.904131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:31.906711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:31.919949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 273/536] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:31.921084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:31.926865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 264/537] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:31.928064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:32.134926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7b7e-c8a8-48cf-8cfd-ea01fa647a05 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:32.160720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5636-0bb6-43ab-9973-3bfa8423dc5e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:32.178124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:32.178838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.180884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.181160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:32.183433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:32.194443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:32.195960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:32.222516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:32.223417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:32.224235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:32.230822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 274/538] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:32.239365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:32.242416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:32.243049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.243325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.243592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:32.244431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=1d6d914a7228452d960c12c0d5db44aa) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:32.244734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:32.246159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:32.254943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 265/539] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:31 2022] GET /identity/v3/role_assignments?user.id=1d6d914a7228452d960c12c0d5db44aa&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:32.296173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:32.406848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3275-4a07-4e38-96c2-36fb9949a166 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:32.465745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:32.466369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.466682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.466956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:32.467657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:32.467962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:32.469444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e874c6-540d-4245-ad46-0d12f8ab7eb4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:32.490367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 275/540] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:32.496502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:32.622929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feeec1-7876-4956-a329-db30f00b7e26 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:32.666092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:32.666621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.667179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.667448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:32.668169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=50a08aac9b9240338d0fec3b5ce7e285) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:32.668469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:32.669887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72584636-c107-4ee4-9520-f87ae4d7d97d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:32.676143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 266/541] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:32 2022] GET /identity/v3/role_assignments?user.id=50a08aac9b9240338d0fec3b5ce7e285&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:32.973789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993236-c9d7-4350-8906-904bf571da91 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.974272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993236-c9d7-4350-8906-904bf571da91 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.974272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993236-c9d7-4350-8906-904bf571da91 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:32.976402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 276/542] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:32.982543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:32.983049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:32.983198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:33.001501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:33.002743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:33.037774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:33.089969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 267/543] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:33.427539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993236-c9d7-4350-8906-904bf571da91 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:33.545226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:33.558898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993236-c9d7-4350-8906-904bf571da91 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:33.606855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:33.607546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:33.607764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:33.608039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:33.625305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:33.630101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:33.631022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:33.632529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 277/544] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:33.637644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:33.751306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae5f4-6d47-4f46-940c-cfaacede9340 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:33.786759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:33.787367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:33.787643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:33.787911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:33.789149 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:33.789451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:33.790843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:33.799695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 268/545] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:33.807799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:33.933619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6c4a6-fc9d-4f50-9131-5094bd250105 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:33.969488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:33.970111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:33.970385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:33.970679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:33.981585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:33.983078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-60a43aab-6976-4985-b29e-67e1c2b30920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:33.998865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:34.000995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:34.002081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:34.002081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:34.002081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:34.002081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 278/546] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:34.005933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:34.056046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:34.131350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81058f-7600-4079-830b-5bc05c751c50 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:34.142734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e9eb-c9fe-4a95-b80a-995a4ec5faf1 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.143017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e9eb-c9fe-4a95-b80a-995a4ec5faf1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.143267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789e9eb-c9fe-4a95-b80a-995a4ec5faf1 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.144862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 279/547] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:34.149340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9056-cccd-4366-82af-7000841fc481 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.149639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9056-cccd-4366-82af-7000841fc481 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.149943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9056-cccd-4366-82af-7000841fc481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.156998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:34.176119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-221e9056-cccd-4366-82af-7000841fc481 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:34.177578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-221e9056-cccd-4366-82af-7000841fc481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:34.200648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:34.201299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.201577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.201847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.202543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:34.202844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:34.204196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:34.218615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 269/548] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:34.224297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:34.346198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 280/549] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:34.392220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:34.406194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba132e0-c004-4964-b43a-c1cbc9ce1e3c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:34.456406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:34.456962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.457238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.457511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.469716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:34.471219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:34.474677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc551-c4fd-4745-afcc-fc124e94c263 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.475225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc551-c4fd-4745-afcc-fc124e94c263 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.476671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc551-c4fd-4745-afcc-fc124e94c263 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.478645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 281/550] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:34.483828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.484333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.484806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:34.485167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:34.486194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:34.487151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 270/551] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:34.491861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:34.508058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:34.509659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:34.627518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 282/552] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:34.651604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c58c-7cb2-4983-b790-5d9e18e9905b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:34.699122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:34.700071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.700571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.701036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.701944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:34.702443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:34.708183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:34.721518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:34.727826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 271/553] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:34.735294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:34.747030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:34.797501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:34.862441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959101b3-02fc-459e-b09f-badd582c23d5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:34.871591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896fcf4-839f-4021-9d02-ce1a2a585107 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:34.923736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:34.924387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.924661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.924930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.941711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:34.942346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:34.942643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:34.942908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:34.960685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:34.968356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:34.969250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:34.970055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:34.971208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 283/554] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:34.980253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.034779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.036318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f8b19-9091-452c-b8db-647e30160e94 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.047268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.110617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e52728-8804-4c11-9467-ad1f4219ccfe None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.133636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.145503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.146191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.146474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.146802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.148281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:35.148584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.149966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.154223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 272/555] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:35.155711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984d5c-8807-4da9-8fb3-aadfa392e69e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.156156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984d5c-8807-4da9-8fb3-aadfa392e69e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.156587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984d5c-8807-4da9-8fb3-aadfa392e69e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.158255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 273/556] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:35.159134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984d5c-8807-4da9-8fb3-aadfa392e69e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.163025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 284/557] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:35.164614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.266548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6f9d1-34bd-4990-96be-b0d4672ae50b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.274298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984d5c-8807-4da9-8fb3-aadfa392e69e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.284369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.302500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.303132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.303410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.303705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.311899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.312519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.313177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.313447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.314571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.316019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.325074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0c620e53-80c3-413d-9090-ecc619ed4e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:35.329876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:35.330831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:35.331631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 274/558] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:35.333347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.333347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.333347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:35.336629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:35.337539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:35.339054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:35.339054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.339054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:35.339054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 285/559] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:35.339054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.356733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:35.357919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:35.386390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.431515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 275/560] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:35.432369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.463126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefcf2-f0f7-4689-b319-966cb1135175 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.504359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.505453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.505906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.506449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.519897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.521770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:35.537817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:35.538862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:35.539711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:35.539711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.539711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:35.545868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 286/561] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:35.546969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.551000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.556189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6eb1-92de-413c-9439-64704bbb11e6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.597009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.597617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.597895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.598168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.598860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:35.599168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.600577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.609139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 276/562] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:35.609924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.652961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.666824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c31c-e5e9-49c4-a990-918641aaec02 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.702674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.703276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.703666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.703940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.704566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:35.704866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.706381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076563d4-1c48-4966-9c2f-cd59378778a2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.715900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498aac-24f2-4be3-88b5-8febac97ac51 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.719057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 287/563] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:35.720523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855897-3d8f-4de5-86f1-7ca2ae0d3043 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.720806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855897-3d8f-4de5-86f1-7ca2ae0d3043 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.721074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855897-3d8f-4de5-86f1-7ca2ae0d3043 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.722427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 288/564] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:35.723083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855897-3d8f-4de5-86f1-7ca2ae0d3043 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.755762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.756353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.756797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.757484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.758110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:35.758457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.759780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.770916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 277/565] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:35.771621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.792593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.828104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855897-3d8f-4de5-86f1-7ca2ae0d3043 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.860218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.860842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.861117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.861392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.871709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:35.872082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc66e4e-cadd-47f3-be9a-ae157b62ccda None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:35.873157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:35.882430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:35.889223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:35.890161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:35.891067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:35.891067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:35.891067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:35.891067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 289/566] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:35.891536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:35.909566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:35.910187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.910462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.910763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.920900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4d53361f-c280-4cb6-bce5-1fb21b1dfcfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:35.926138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:35.927416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:35.928240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 278/567] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:35.929489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:35.929489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:35.929618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:35.947601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:35.948787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:35.988176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f6e7c-8d3d-4f5d-8cb2-72f6bba777b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.013855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 279/568] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:36.014694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.026860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.030995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.031626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.031900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.032173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.039987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.041454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:36.053063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.054552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 290/569] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.055452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.118374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.125154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e0166-c378-4a63-88f1-d5f17151e7cd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.160634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29334-6193-45e0-b95b-2cf6ff51d8d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.161078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.161698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.162008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.162241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.169857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.171326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:36.183755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.184704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 280/570] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.185626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.200656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.201260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.201544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.201816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.202445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.202785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.204150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.216784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 291/571] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:36.219377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.260839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.293961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adb6a-1114-494e-b35c-4f15e9ee4249 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.321409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb021e-a996-4e1e-9cfb-0722d6fec638 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.327894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.328502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.328781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.329054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.329716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.330018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.331420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.339863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 281/572] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:36.340647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.342586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.359031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.359710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.359986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.360249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.360915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.361206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.362644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.374585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 292/573] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:36.375393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.465405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeebe8-3427-45ef-b451-e83682e219f3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.487137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3bbe-b407-4011-bff0-80f2a16bfd7b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.500052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.505493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.506206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.506580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.506934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.507661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.507960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.509418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.520699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.521317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.521591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.521860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.528384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 282/574] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:36.529203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.530692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.532128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:36.543921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.544913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 293/575] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.545847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.587352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.630029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90595-4b9e-4d8c-a5e9-d0223662e979 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.644523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb20ee-7fb0-412c-940f-96a6086878ed None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.663862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.664481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.664750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.665014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.674858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:36.677811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.678430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.678755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.679025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:36.679877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.680947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 283/576] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.681949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.692201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.693646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:36.708037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.709006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:36.710429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:36.710429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:36.710429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:36.710429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 294/577] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.710429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.740562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.790210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aae21-7fd4-4226-b429-d28adcdcd313 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.799874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.809398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ab1e6-ebae-415c-8e34-7504b3f9e89b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.824446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.825036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.825304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.825567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.826273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=81bce1766c4c4ed09127855dd79ec9bd) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.826600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.828182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.833492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 284/578] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/role_assignments?user.id=81bce1766c4c4ed09127855dd79ec9bd&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:36.834282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.858766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.859909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.860313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.860647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.873618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.875252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:36.891657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:36.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:36.893568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:36.893568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:36.893568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:36.893568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 295/579] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:36.893800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:36.951892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a7129-54a3-45db-8f99-5f7722bd8061 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:36.968512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:36.991091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:36.991709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:36.991989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:36.992263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:36.993006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:36.993316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:36.994812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.010131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba6f-8616-40c7-a4c7-c37eaa2f9ae2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.018531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 285/580] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.018531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.050881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.051861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.052579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.053025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.053878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.054471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.056235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.065958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 296/581] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.067305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.078066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.129365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4e2e-1d45-4d15-8657-eb3c99c7afae None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.167240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.167999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.168272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.168592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.169410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.170034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.171418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.179059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef96d-6ff8-452d-bb69-529a69c3162b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.188165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 286/582] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.188165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.218109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.220266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.220929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.221175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.221483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.222114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.222412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.223797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.235583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 297/583] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.236888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.298268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff83bd-5efa-451e-8abf-5fff705bc63d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.311440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.337151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.337862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.338203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.338574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.349809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.351293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.351937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71895d-7de7-48a6-811b-730b350cbd44 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:37.366895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:37.368037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:37.369207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:37.369207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:37.369207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:37.372546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 287/584] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:37.373158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.394453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.395252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.395637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.396002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.406136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.407623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:37.425082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:37.426229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:37.427635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:37.427635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:37.427635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:37.429393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 298/585] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:37.430032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.471590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.488909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ce4d5-bd4c-4bc3-80e4-d0c34e8b3a2c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.528181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.528818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.529384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.529384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.537585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.538696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ce66-c45d-40b6-ae28-6256425defd8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.539631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:37.551829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:37.553251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:37.554975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 288/586] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:37.558288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.560565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.578312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.578974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.579311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.579650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.587101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.588669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:37.600910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:37.602059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:37.603311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:37.604476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 299/587] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:37.605422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.670591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11822-38b3-443d-936d-dfa129983f07 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.707789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.708411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.708686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.708961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.709616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.710509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.712004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.726374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 289/588] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.727115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.731883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.733760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9c2fa-8540-4a77-967a-6d2ed998c87b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.769479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.770143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.770419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.770714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.771345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.771642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.773652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.789728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 300/589] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.789728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.829473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:37.845409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0e5e9-a477-4cb3-b062-82c976485095 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.882829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.883421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.883696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.883949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.884661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.884955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.886381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.895218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e63b06-6dbd-44f1-9104-249dc19bdeda None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:37.904530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 290/590] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.905323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.937615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:37.938218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:37.938512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:37.938786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:37.939466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:37.939767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:37.941193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:37.953726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 301/591] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:37.955379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:37.974182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.018033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4dde7-ecbe-4e6a-a312-859c3a39ba1a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.055228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.055903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.056188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.056508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.060099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.064440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5216fd-6d15-4c38-8955-7c8705a1f596 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.065139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.067296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:38.080414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:38.086091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 291/592] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:38.087244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.116732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.117411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.117684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.119248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.130824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.132991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:38.144594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:38.145717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 302/593] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:38.147524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.208499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b031869-22d6-45fd-98d9-0c0c887ea7c6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.231518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.245371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.246072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.246415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.246778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.250718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f156-b500-4074-9edc-70232ccf0ad9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.258102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.259661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:38.273916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:38.275066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:38.276129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:38.276129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:38.276129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:38.281430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 292/594] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:38.281430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.293535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.294283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.294665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.295006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/51a2f331dfa2463a9af3282f8d9569e2/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.311738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=51a2f331dfa2463a9af3282f8d9569e2, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.313177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.334882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 303/595] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:38 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/51a2f331dfa2463a9af3282f8d9569e2/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:38.335917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.355743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.412545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705811-5f96-489d-bfb5-0e5544d51301 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.456177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.457080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.457499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.457910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.458787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:38.459232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.461042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.480755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 293/596] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:38.482161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.498224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf3ce-3bf3-43e0-a356-f96a5b927791 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.530760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.545894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.546657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.546935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.547204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.547961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:38.548395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.550671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.576267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 304/597] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:38.577313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.618371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25735-72d2-4d31-a3e3-4433a57f9017 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.664523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.665148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.666833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.667311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.667717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.668612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:38.669269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.671680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.687269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 294/598] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:38.692197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.704230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64d49-9c3b-4535-b8f6-fe8aaf7c9e8f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.739790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.740511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.740788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.741123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.756776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=6fe2a726da0f429ba1de83b2ff0ea950, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.758237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.782515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 305/599] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:38 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:38.782515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:38.833310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.847623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b367-b032-43a0-a816-599255e78179 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.924930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead9387-2b51-4302-82ec-3b887946d955 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:38.954969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:38.958785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.959801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.960104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.960382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.970074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:38.970755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:38.971032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:38.971302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:38.981238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.982767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.991798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:38.993370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:38.997212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:38.998083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:38.998987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 306/600] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:39.005256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c10bca59-0301-4c05-9c5f-5d2cc155915a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:39.030686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:39.031658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:39.032515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:39.032515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:39.032515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:39.034587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 295/601] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:39.036031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420946c-4a1f-49e4-9866-0c8aad6abba7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.036524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420946c-4a1f-49e4-9866-0c8aad6abba7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.036985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420946c-4a1f-49e4-9866-0c8aad6abba7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.039049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 296/602] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:39.043418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420946c-4a1f-49e4-9866-0c8aad6abba7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.132753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e890-b44d-48e6-aeaf-7580d12a20f2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.175448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:39.175638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420946c-4a1f-49e4-9866-0c8aad6abba7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.176493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.177062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.177804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.178789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:39.179299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:39.181017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a45d-a7cc-4e9b-b179-6da4174692f8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:39.196244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 307/603] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:39.197918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.198433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.198939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.219760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:39.221314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:39.222038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.222327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:39.222431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.222790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.223498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:39.223862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:39.226061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:39.242600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 297/604] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:39.243802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.256895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:39.270983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:39.363371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 308/605] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:39.364490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.389581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a434f9-3ad8-4964-93dc-5cd389961e7e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.428652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:39.429656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.430145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.430647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/1d6d914a7228452d960c12c0d5db44aa/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.454895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=1d6d914a7228452d960c12c0d5db44aa, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:39.457317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:39.482159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 298/606] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:39 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/1d6d914a7228452d960c12c0d5db44aa/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:39.574667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872e451-5b1d-45eb-934e-f9fd38c8e4bf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.624561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:39.625220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.625507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.625770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.638991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:39.640466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:39.663316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:39.664345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:39.665256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:39.669134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 309/607] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:39.670934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.695583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.737813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:39.743374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:39.788429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c58d-e98e-4410-b125-e29f052840bb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.828300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:39.828971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:39.829254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:39.829522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:39.830213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:39.830605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:39.832036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:39.846039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 299/608] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:39.853329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:39.898408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a331f-4308-428d-ad4e-4cae475d1b7f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.973692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8b43-9355-45d6-9f3e-c5bfa94e3bc9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:39.990857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:40.003997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.005102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.005665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.006270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.010471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.011178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.011493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.011823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/50a08aac9b9240338d0fec3b5ce7e285/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.028159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=50a08aac9b9240338d0fec3b5ce7e285, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:40.029732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:40.032322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:40.043974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:40.044941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:40.045772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:40.046430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 300/609] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:39 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/50a08aac9b9240338d0fec3b5ce7e285/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:00:40.047919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 310/610] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:40.064831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:40.226382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b3c6-0862-4566-8e21-69eb7ae9fff5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:40.276757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.277369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.277642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.277908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.278712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:40.279008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:40.280390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:40.294599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 301/611] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:40.299570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:40.423765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:40.442455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6effafd-dd0c-4e1a-88a1-8af229237932 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:40.495302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.495865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.496144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.496417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.508582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:40.510023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:40.530540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:40.531525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:40.532406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:40.532406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:40.532406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:40.532406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 311/612] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:40.538285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:40.573320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:40.667221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a3071-37c8-4d20-b323-10f85025f492 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:40.702791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.703405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.703678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.703946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.704655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:40.704959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:40.706325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:40.724069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 302/613] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:40.730250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:40.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6ea8-3de4-4e42-8cbf-500cff1e2be4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:40.898123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:40.898784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.899059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.899412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:40.907687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:40.909176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:40.911052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-82d84686-bcf3-44ae-a8ae-37e50924b488 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:40.922421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:40.923432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:40.924358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 312/614] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:40.929814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:40.997343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480267-c5b9-4707-aba3-6fde3da9e3a5 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:40.998073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480267-c5b9-4707-aba3-6fde3da9e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:40.998356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480267-c5b9-4707-aba3-6fde3da9e3a5 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.000232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 313/615] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:41.012590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.012893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.013117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.043552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:41.044748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:41.087003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.106740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345ea6-7d45-4193-ae67-bb1440ef75bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:41.172027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 314/616] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:41.173971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:41.174621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.174894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.175159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.175893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:41.176192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:41.177900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d73ea4-08e3-4d2a-89de-5c6e55feebfd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:41.202287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 303/617] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:00:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:41.208107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:41.340999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dbf40-ad2c-4ed9-9b2b-18be35ca2fd8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:41.376959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.386325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:41.387009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.387280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.387547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.403540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:41.405047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:41.410251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535e50-42ea-4ea0-ae68-102376215f95 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.411140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535e50-42ea-4ea0-ae68-102376215f95 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.411621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535e50-42ea-4ea0-ae68-102376215f95 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.414328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 304/618] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:41.419502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.420477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.420945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:41.428648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:41.429569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:41.430890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:41.430890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:41.430890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:41.436089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 315/619] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:41.441520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:41.443156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:41.444705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:41.567189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 305/620] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:00:41.598703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef136ca-f6fa-4df0-a9aa-a90193e0e01f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:41.633962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:41.634955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.635429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.635887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.636453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:41.637093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:41.637584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:41.639188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:41.658518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 316/621] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:41.664649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:41.714684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.736482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:41.788646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb0cb1-6c08-4291-9e5f-f462a7568f18 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:41.799257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c77f-c3fc-41ea-ac6d-3928170470f5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:41.845817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:41.846447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.846741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.847010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.860552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:41.861994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:41.871260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:41.871893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:41.872159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:41.872418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:41.885446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:41.886366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:41.887293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:41.891252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:41.892294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 317/622] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:41.896765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:41.898239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:41.899858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:41.901482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:41.908710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 306/623] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:41.909551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.019684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.023836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5df8-3b78-4ec0-9ff0-edd0935c6b6c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.045744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f62cb-13cf-4b86-afca-eb781fb715db None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.063017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.063738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.064177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.064537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.065364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:42.065754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.067327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.080995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 318/624] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:42.081964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.087593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.088206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.088481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.088752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.089410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:42.089709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.091209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.093678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.100999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 307/625] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:42.101814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.194982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362ee4-6788-4003-9734-5aed92d924b6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.215624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02772dc0-d4b2-41d1-a0c5-fd19ce6a8aa3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.230851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.231563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.231901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.232252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.243892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:42.249100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:42.250982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:42.251835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:42.254148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.255017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.255497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 319/626] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:42.255669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.256091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/81bce1766c4c4ed09127855dd79ec9bd/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.256340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.273349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=81bce1766c4c4ed09127855dd79ec9bd, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.275103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.280170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.298470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 308/627] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:42 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/81bce1766c4c4ed09127855dd79ec9bd/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:42.300118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.381315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.400402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654cee4-14ab-48ee-9658-5ba339489ada None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.452759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.453319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.453596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.453864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.456590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aace9-a242-4fbf-9591-772083c005c1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.469016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.470585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a5ca81cf-ddb3-4219-92c0-81288fad1383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:42.487236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:42.488372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:42.489248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:42.489248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:42.489248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:42.493756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 320/628] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:42.495171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74544-01a7-42ef-a549-702f950204d0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.495463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74544-01a7-42ef-a549-702f950204d0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.495711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74544-01a7-42ef-a549-702f950204d0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.498565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 321/629] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:42.499395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d74544-01a7-42ef-a549-702f950204d0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.504425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.505038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.505307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.505571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.506254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:42.507027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.508109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31681210-9ad4-4f38-9694-0805c16f1abd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.517099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 309/630] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:42.518136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.518413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.519462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.539401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:42.540717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:42.587391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.630375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d74544-01a7-42ef-a549-702f950204d0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.638546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 310/631] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:42.638546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.709376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.711287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.711732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.712186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.715003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:42.715503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.717038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.729006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.744751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 322/632] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:42.751374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.818044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e1387-d939-4e9c-984e-a1c028bb3086 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.857327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.857947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.858226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.858665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.874091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.875806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.876807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94377-8952-4ae7-bab5-a0315caf3dd8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6dbd5b50-3c09-43c5-9b06-ac81542b0604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:42.893919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:42.895139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:42.896017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:42.896017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:42.896017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:42.896017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 311/633] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:42.896543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7859c-cd97-4f3f-8bb8-093a0d391aa4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.896821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7859c-cd97-4f3f-8bb8-093a0d391aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.897625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7859c-cd97-4f3f-8bb8-093a0d391aa4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.902557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 312/634] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:42.904507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7859c-cd97-4f3f-8bb8-093a0d391aa4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:42.914879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:42.921868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:42.922726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.923155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.923559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.931634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:42.933349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c611889b-6101-482a-8eb7-1e135968379c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:42.947279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:42.948262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:00:42.949204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:42.951661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 323/635] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:42.952682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:42.952963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:42.953232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:42.974182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:42.976004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:43.014672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.026615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7859c-cd97-4f3f-8bb8-093a0d391aa4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.047533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 324/636] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:43.048886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.062843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.063762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.064294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.064788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.065776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:43.066287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.068021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.082856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 313/637] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:43.086830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.175244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78c67-703a-4900-a86b-8338f48afe07 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.204167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.213051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735a73-ef9f-44bd-a642-5bff60b61705 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.225243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.226662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.227183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.227986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.242553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:43.249890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:43.250859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 325/638] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:43.255087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.260130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.261705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.261997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.262275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.263056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:43.263366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.264814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.298061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 314/639] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:43.298061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.311062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.380527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb69cb-314b-4c04-bce0-83fe73b48308 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.408582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a0af-bd0b-42f8-b1cc-cc674f3c9fb7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.416443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.417355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.417355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.417603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.424404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.425830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:43.437678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:43.438661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 326/640] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:43.439600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.451440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.452042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.452317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.452585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.453230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:43.453531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.454912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.467960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 315/641] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:43.467960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.490462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.543697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.551368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437fed5-5e11-4497-9d9f-9820da3bd649 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.576233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ddb0-6cb2-4ac5-b63e-719831ed6ece None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.587434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.588035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.588334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.588613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.614146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.615794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.616301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.617011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.629643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:43.636015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:43.637012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:43.637874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:43.642510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 316/642] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:43.642510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.666851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.668515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.713544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.751422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690ea56-8cea-47d0-993f-eeea5221b35b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.774471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:43.779215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.785507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.792227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.792827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.793221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.793494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.794336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:43.794670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.796092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.819531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 317/644] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:43.819531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.881754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a571-027a-45a3-bc7c-a26b0e6a493b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.918017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.918663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.918928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.919243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.926205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a714dd-154a-479b-a1a1-1f2489aa7671 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:43.929558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.931024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.932827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:43.948102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:43.949081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:43.950146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:43.950146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:43.950146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:43.950146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 328/645] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:43.950146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:43.968720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:43.969327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:43.969610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:43.969879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:43.970582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:43.970877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:43.972272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:43.980685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 318/646] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:43.981446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.039091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.062823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e7b01-c63b-4a42-aae7-ebbd651ec414 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.090975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19a7a3-ea4a-443e-8830-6011cf4efad9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.100473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.101105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.101380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.101955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.112548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.114145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.125813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.126419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.126730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.127001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:44.128813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:44.129687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:44.130639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:44.130639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.130639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:44.130639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 329/647] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:44.130883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.181461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.204716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.206147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.238267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c35b9-4f14-4b28-9c32-f540e06b3999 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.261543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.272684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.273409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.273776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.274143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.274906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:44.275304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.276804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.289421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 330/648] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:44.294576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.316007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 319/649] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:44.316767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.414786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb960b-3f81-4ffd-a3fb-58ced211e321 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.421812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221b550-d7c8-449f-acd8-ff225aaf5ca9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.422440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.455526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.455832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.456026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.456259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.466640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.467391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.467767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.468142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.468789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:44.469087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.470442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.470643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.472016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.488991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 320/650] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:44.488991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:44.489220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:44.490116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:44.491110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:44.491110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.491110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:44.491110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 331/651] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:44.491110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.506990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.597201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebce9-b695-4037-a58c-20b5ad5d3b40 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.600865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee283c-14e3-4167-b8d7-5891e6a674f7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.630770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.631404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.631730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.632004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.634103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.634752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.635025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.635292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.642157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.642608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.643631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.644019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:44.655439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:44.656525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 321/652] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:44.657450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:44.658204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:44.659157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:44.660021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:44.660021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:44.660021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:44.660021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 332/653] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:44.660249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.675614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.733852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.762872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dca97-eef9-4a06-b66b-94c760190587 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.764000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d55fe-b24c-4d66-987d-e9261a5c75f8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.805244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.805534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.806152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.806379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.806470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.806686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.806776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.806956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.807341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:44.807639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.809063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c8bef-bb06-4d8e-95b7-ac07d58e41e7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.817199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.818789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.821595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 333/654] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:44.822827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43790-dfe6-4e94-9bfc-5daf5473ab75 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.823108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43790-dfe6-4e94-9bfc-5daf5473ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.823379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43790-dfe6-4e94-9bfc-5daf5473ab75 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.828614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 334/655] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:44.828614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43790-dfe6-4e94-9bfc-5daf5473ab75 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:44.834272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:44.835973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:44.837527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:44.838750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 322/656] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:44.839557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.895006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.925924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43790-dfe6-4e94-9bfc-5daf5473ab75 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.939355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4972df-cc2c-4afd-ad7a-cddd348403c8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:44.959317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.960526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.960802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.961071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.961775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:44.962075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.963536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.969898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:44.975242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:44.975832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.976104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.976372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:44.976996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:44.977300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:44.978657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af976e-569b-4861-ad8f-8b5c027471fd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:44.980207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 335/657] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:44.981170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:44.991172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 323/658] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:44.992626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:44.992905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:44.993169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.011032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:45.012225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:45.078061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 324/659] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:45.078909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.084133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff9cf-3213-4904-ba03-0c7879aee49f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.115351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.127158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.127786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.128066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.128330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.136334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.137781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:45.149469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:45.150769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:00:45.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:45.155106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 336/660] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:45.155879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.197697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee216-f58a-4f33-90cb-0874f615807a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.220666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.232924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.233667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.234030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.234405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.235205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:45.235595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.237094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.249949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 325/661] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:45.250782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.271048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd5da-83ae-491a-bb97-5199c9b2ebdf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.307523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.308180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.308391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.308654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.360419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08d1e3-79ca-4693-9d4a-4e720265d358 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.365104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.379088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.380623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.394950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.395567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.395841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.396106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.402711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.404081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:45.415104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:45.416225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 326/662] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:45.417117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.462537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.479379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 337/663] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:45.480209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.519265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e918d-fc83-454b-a3fc-f4038d4e828b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.553000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.554148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.554411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.554733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.555457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:45.555753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.557158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.566247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.575519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 327/664] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:45.576200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.579307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d3ef-2996-42a1-89e5-da7f9a33e06f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.612622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.613212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.613484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.613747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.614447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=51a2f331dfa2463a9af3282f8d9569e2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:45.614774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.616811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.622407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 338/665] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/role_assignments?user.id=51a2f331dfa2463a9af3282f8d9569e2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:45.623183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.677539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.680902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169e5d-c587-4b0d-b33d-95e62cc7e659 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.723116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.724059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.724331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.724599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.737426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:45.743570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:45.744733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:45.745772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:45.750244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 328/666] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:45.751215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.761445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dc8b6-a227-4272-99b3-868f5337ffe4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.799258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.800748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.800748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.800748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.801333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:45.801636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.804163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.819688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 339/667] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:45.820989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.838195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.873086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40876daf-70b2-402d-abc7-e10e255b1d31 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.909634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.910642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.911138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.911472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:45.922675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:45.924361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:45.930800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa93cd-b6ca-48ba-b78d-61f2bdca20cc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:45.940663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:45.941605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:45.942877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:45.942877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:45.942877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:45.942877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 329/668] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:45.942877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:45.958167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:45.972197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:45.972800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:45.973097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:45.973335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.044545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.046005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.053137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e253d-ede3-4e36-a5f3-b505e33d1984 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.060546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.089720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.090623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.090734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.090945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.091596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.091894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.093246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.101932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 330/669] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.104227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.158641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 340/670] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:46.159518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.192923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.219046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a27ca-3e85-40c6-9909-7f6e06e676d2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.254870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.255468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.255744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.256017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.256763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.257066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.258502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.264353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 331/671] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.265121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.265475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a5141-4eb6-4219-8264-578e7f9e73f0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.293937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.324774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.326151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.326506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.326840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.327565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.327960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.330372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.347782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 341/672] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.349226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.409195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d70cd-77f9-4e43-99bb-f8decd2f51e8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.452660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.453337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.453797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.454142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.462976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.469274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.471500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:46.489463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:46.490557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:46.492041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:46.492041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:46.492041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:46.494324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 332/673] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:46.494324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.503447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60651177-29fd-46f0-b766-c6220932dc08 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.548017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.548670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.548948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.549218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.568138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.568693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:46.590085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:46.591173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:46.592123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:46.592123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:46.592123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:46.593556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 342/674] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:46.594340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.619584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe384-4a91-42db-908c-84ad5591ec23 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.627766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.675330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.675999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.676273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.677375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.686012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.688054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:46.703900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:46.705003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 333/675] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:46.706078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.716296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bdee4-6975-4567-9871-ca487864dd1a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.751399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.752156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.752493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.752820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.753529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.753883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.755335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.768565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 343/676] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.769522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.777840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.844490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ce714-9321-4dbd-9820-4cfaa8f16b76 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.881251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.881876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.882148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.882413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.883076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.883373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.884656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:46.884778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.901969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 334/677] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.901969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:46.913187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca716ea-8c53-44f0-88b6-4f8e1270af0c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:46.958722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:46.960315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:46.960747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:46.961529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:46.962708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:46.963162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:46.965248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:46.981503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 344/678] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:46.982614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.008500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bbbda-122d-4c41-a19f-c054ec43fefa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.020414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.047664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.048624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.049098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.049606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.058230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.060138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:47.074047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:47.075037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:47.075963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:47.078863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 335/679] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:47.079975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.113413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b4ce-7bc0-4b7b-a598-e90b306dabb3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.154571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.155546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.156092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.156575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.164158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.166117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:47.179177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:47.180085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:47.181035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:47.183536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 345/680] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:47.184638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.188603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.204502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504ac9-1e95-4c3a-ac9f-c21a64b3f93f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.244759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.246191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.246651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.247332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.248196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=1d6d914a7228452d960c12c0d5db44aa) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:47.248729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.250392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.258500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 336/681] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/role_assignments?user.id=1d6d914a7228452d960c12c0d5db44aa&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:47.259481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.300008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906aba7-7e9b-42c0-9ca1-07b45ed85261 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.310117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.351197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.352209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.352684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.353155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.354289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:47.359104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.361666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.393681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344da38-ccde-4ae5-978a-f693b68a9950 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.404289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 346/682] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:47.414552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.465324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.466307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.466854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.467360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.468265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:47.468562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.470011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.498710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 337/683] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:47.505162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.520583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.571632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e178b-b5af-43f0-b146-b543285a723b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.614832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.615443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.616402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.616680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.619536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.628400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c073-5393-4f6e-8efd-fe0fc219f8be None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:47.670467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:47.671461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.671916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.672373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.673230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=50a08aac9b9240338d0fec3b5ce7e285) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:47.673673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.675453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.684581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 338/684] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/role_assignments?user.id=50a08aac9b9240338d0fec3b5ce7e285&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:47.696908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:47.698414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b29194-a727-4f89-a20f-a92c04c6e82e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:47.766061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:47.813605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 347/685] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:00:47.819443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:47.914548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489a3b-2650-4ce2-9685-5462419c108f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.914989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489a3b-2650-4ce2-9685-5462419c108f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.915368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76489a3b-2650-4ce2-9685-5462419c108f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.917061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 348/686] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:47.922222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:47.922549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:47.922801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:47.941423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:47.942637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:47.996797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc047996-192c-4a06-877f-62d02f420065 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:48.038795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:48.039605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:48.040052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:48.040417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:48.041100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 349/687] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:48.057371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:48.059010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:48.074734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:48.075686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:48.076553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:48.076553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:48.076553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:48.076553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 339/688] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:48.081791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.178997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:48.188293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324d6e7-a88d-4935-82f9-ef6da3658fb2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:48.223817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:48.224422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:48.224697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:48.224965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:48.225634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:48.225933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:48.227410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:48.239436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 350/689] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:48.245606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.259746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:48.351688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.357180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599d480-d866-4b6f-a129-cb6fcaf1bf0b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:48.410515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:48.411155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:48.411431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:48.411757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:48.422670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:48.424125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:48.445748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:48.446740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:48.447608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 340/690] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:48.453207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.542319 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:48.596420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97e53e-7031-4763-8380-d18bdde5f969 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:48.668665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bde57e-4edb-487d-a513-55ab7a119e0d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:48.710423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:48.711109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:48.711399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:48.712951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:48.712951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:48.713586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:48.743785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:48.744894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:48.745823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:48.755083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 351/691] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:48.763572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.782762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:48.783374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:48.783650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:48.783920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:48.784606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:48.784903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:48.791597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:48.816273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:48.837512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 341/692] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:48.844552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:48.960837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47785e0d-6212-40e2-84c7-92883cce27a6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:49.001744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:49.002580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.002857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.003124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.003748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:49.004044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:49.005411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1663d-c815-4008-9709-cbbf5d62ad79 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:49.014621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 352/693] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:49.014621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9dedf-7c97-41ef-913b-0cf88c2ca880 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.014621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9dedf-7c97-41ef-913b-0cf88c2ca880 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.014621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9dedf-7c97-41ef-913b-0cf88c2ca880 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.014621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 353/694] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:49.019375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9dedf-7c97-41ef-913b-0cf88c2ca880 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:49.068500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e13054-db85-49e3-9a99-b16fbdf3dfcf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:49.110858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:49.119121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:49.120502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.121240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.121743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.122946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=81bce1766c4c4ed09127855dd79ec9bd) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:49.123880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:49.126080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f165f03-740a-45df-8a78-966623f83d98 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:49.135213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 342/695] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:48 2022] GET /identity/v3/role_assignments?user.id=81bce1766c4c4ed09127855dd79ec9bd&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:49.137855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.138601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.139270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.162261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:49.164506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:49.168964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:49.245020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 343/696] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:49.247817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9dedf-7c97-41ef-913b-0cf88c2ca880 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:49.285697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:49.286689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.287192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.287754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.288577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:49.289072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:49.290784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:49.297392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 354/697] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:00:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:49.548513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:49.653153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c7ab-4c87-474d-97da-92d64ca597bd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:49.679396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:49.689440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:49.690069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.690342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.690635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.701538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:49.706422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:49.707392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:49.708248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:49.712325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 344/698] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:49.713717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:49.819736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac396-fe58-4ad6-a8af-3c57fc0b1579 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:49.854809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:49.855412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:49.855686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:49.855953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:49.856609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:49.856905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:49.858270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:49.871997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 355/699] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:49.873359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:49.977611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a670-9f0a-4f29-a0e8-e1e90c5b74c0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.012621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.013253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.013525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.013792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.024894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:50.026342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d4674f8c-07fc-4962-9a3c-ff43d5dfde16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:50.042356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:50.043350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:50.044227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:50.044227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:50.044227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:50.044227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 345/700] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:50.050408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:50.065567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:50.205553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cebd4-3647-4d6f-a32a-f19431eca24a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.260116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.260730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.261003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.261270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.261902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:50.262197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:50.263592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:50.268594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474385-d46c-484d-9792-27f0b6592de4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.269144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474385-d46c-484d-9792-27f0b6592de4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.269618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51474385-d46c-484d-9792-27f0b6592de4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.271419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 346/701] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:50.276810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 356/702] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:50.277077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.277546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.278034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.286150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:50.307924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:50.309237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:50.370199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:50.420765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:50.445303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 347/703] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:50.478877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a54e-e1ee-4c8e-9bd3-01ba18126da1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.528645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.529275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.529548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.529808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.543505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:50.545004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:50.557659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:50.558617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:50.559555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 357/704] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:00:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:50.564244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:50.683100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e87e37-1b81-411e-8f7b-18ce793a11f0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.722916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.727244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.727531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.727777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.728541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:50.728843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:50.730373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:50.758615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 348/705] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:00:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:50.760593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:50.814359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:50.843683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:50.905789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b957-e6a1-4150-b74a-6e3340f36776 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.936359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e939-0415-4b1b-962c-f83f19fe0f72 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:50.939195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:50.948655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.949249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.949525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.949794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.974829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:50.975987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.976419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.976690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] PATH_INFO: `/v3/services/network` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.977598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:50.979255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-79820026-abe3-4e6f-9aee-cb513862d919 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:50.991485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:50.992643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:50.993609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:50.995837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 349/706] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:50 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:50.997199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46d03-1d43-45b6-8235-fc01b8a09ff9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:50.997603 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46d03-1d43-45b6-8235-fc01b8a09ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:50.998022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46d03-1d43-45b6-8235-fc01b8a09ff9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:50.999639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 350/707] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:51.004997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46d03-1d43-45b6-8235-fc01b8a09ff9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.028268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.029726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed72d3-5177-4923-934f-b1e1e30b7ed3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.112970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:51.128843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46d03-1d43-45b6-8235-fc01b8a09ff9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.145573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 358/708] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:51.147777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.148288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.148874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.168483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:51.169340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.169952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.170222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.170509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.170974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:51.171137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:51.171597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.173087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.178720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 351/709] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:51.179894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.194269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:51.247345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 359/710] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:51.248481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.343375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0241-8c1b-445a-b3b3-d978213edbfb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.397592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.398223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.398530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.398779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.415052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.418156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.443198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866967e2-66c2-4ba2-b41f-d81fa7ec46c3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:51.448426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:51.449354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:51.450221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:51.450221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:51.450221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:51.450810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 352/711] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:51.464839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.475561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:51.488412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.489016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.489285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.489549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.490172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:51.490469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.491878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.505078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 360/712] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:51.599186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.639884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:51.672016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823cfb-b9b4-4b3f-907c-4f4ae2046fa3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.732141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.732777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.733019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.733292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.733934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:51.734234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.735647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f013f-b21d-4cc0-93be-7e125c8faa28 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.749938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 353/713] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:51.751271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d74c-3f1f-4639-b727-b9968d6db5d4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.751558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d74c-3f1f-4639-b727-b9968d6db5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.751833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d74c-3f1f-4639-b727-b9968d6db5d4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.753381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 354/714] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:51.758398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d74c-3f1f-4639-b727-b9968d6db5d4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.770373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229478-2023-4c3c-98a3-59feab4296a2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.811541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.812409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.812828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.813339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.824414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:51.826372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.828123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-dacc6b35-9080-4c65-a6d4-a74b228be613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:51.847329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:51.848336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:51.849203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:51.849203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:51.849203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:51.857499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 361/715] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:51.859101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.859550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.860016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.868935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d74c-3f1f-4639-b727-b9968d6db5d4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:51.879436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:51.880982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:51.907279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161a38-8531-4328-9610-05333659adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:51.908011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161a38-8531-4328-9610-05333659adfa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:51.908359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161a38-8531-4328-9610-05333659adfa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:51.908702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed161a38-8531-4328-9610-05333659adfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:51.917976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed161a38-8531-4328-9610-05333659adfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:51.920086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed161a38-8531-4328-9610-05333659adfa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ed161a38-8531-4328-9610-05333659adfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:51.934001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:51.934985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:51.935911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 355/716] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:51.936427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161a38-8531-4328-9610-05333659adfa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.970673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 362/717] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:51.971859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:51.974575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:52.091057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed161a38-8531-4328-9610-05333659adfa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.132796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed1c6-250e-4208-a48c-1cd21551bf9f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.135022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:52.147641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.148564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.149017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.149425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.150298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:52.150862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:52.152468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2256b-7ad8-435d-a165-e88ae59ac912 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:52.166393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 356/718] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:52.168109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb7c-ab97-41d6-9650-59e42373f1ce None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.168564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb7c-ab97-41d6-9650-59e42373f1ce None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.169004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb7c-ab97-41d6-9650-59e42373f1ce None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.170393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 357/719] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:52.178201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870cb7c-ab97-41d6-9650-59e42373f1ce None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:52.188917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.189623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.190103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.190637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.191606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:52.192105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:52.194343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35017e-1925-41f7-b127-dc9966dc44d8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:52.217579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 363/720] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:52.219388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.224387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.224970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.254117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:52.255912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:52.294194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870cb7c-ab97-41d6-9650-59e42373f1ce None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.333411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:52.333728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.335352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.335721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.336286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.337453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:52.339081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:52.350796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 364/721] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:52.350796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:52.367134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 358/722] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:00:52 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:52.368179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:52.423132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:52.506636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b291ff-bd72-4528-a127-3588cac41bf2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.551617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.554666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.555120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.556476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.557317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:52.559183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:52.581269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87543-b90f-4d74-8109-4c396d5a405a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.586871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 359/723] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:00:52 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:00:52.637380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.637912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.638359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.638665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.639411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:52.639783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:52.641379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:52.648308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 365/724] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:52 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:52.731001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:52.855679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:52.860133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac963e92-de7a-4fd8-b998-1cc740e6dd73 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:52.897413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:52.898009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:52.898286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:52.898621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:52.909601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:52.915082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:52.916007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:52.917014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 360/725] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:52.922259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:53.002558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:53.066158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1e3a-0f66-46ed-bf02-f990d6c81b48 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:53.109726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:53.110669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:53.111125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:53.111682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:53.112512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:53.112986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:53.114533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:53.128520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 366/726] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:53.133950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:53.247917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a8bf-bad6-4220-bd2a-52ea7509523f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:53.299770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:53.300729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:53.301182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:53.301640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:53.316715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:53.318427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:53.340350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:53.341327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:53.342200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:53.342200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:53.342200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:53.343682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 361/727] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:53.349137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:53.491344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80db06-a28a-4726-8282-fc3649388265 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:53.505819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:53.535573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:53.536364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:53.536646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:53.536914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:53.540984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:53.540984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:53.540984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:53.563184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 367/728] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:53.571846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:53.589379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:53.698643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538747a-e0b2-465e-9fab-1b9690385add None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:53.742176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:53.742852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:53.743130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:53.743407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:53.755433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:53.756972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-833c492a-f94d-4f9f-bc47-7e356768e549 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:53.771040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:53.772003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:53.772918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 362/729] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:53.780136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:53.946430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6023-7661-4d62-bcf6-109357a5d9df None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:54.000993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:54.001960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:54.002438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:54.002967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:54.003882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:54.004400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:54.006021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:54.017911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb59cc-865c-45af-a6e8-27fed9369565 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:54.018420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb59cc-865c-45af-a6e8-27fed9369565 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:54.018420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb59cc-865c-45af-a6e8-27fed9369565 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:54.020003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 363/730] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:54.026439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:54.026741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:54.027014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:54.028155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 368/731] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:00:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:54.035897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:54.065830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:54.068213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:54.096924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:54.185182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45addbd9-8265-4295-abd8-e29a01e449ef None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:54.234254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:54.235420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:54.236973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:54.238034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:54.245719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 364/732] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:00:54.317702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:54.319581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:54.362985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:54.437149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 369/733] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:00:54.448214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:54.452253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:54.609509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc784507-12ca-4245-9d7a-362fc297ee01 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:54.659767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:54.660407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:54.660684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:54.660959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:54.674211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:54.675699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:54.695674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:54.696645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:54.697543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:54.697543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:54.697543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:54.697543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 365/734] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:54.704473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:54.835015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:54.979787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da135b-4a48-45e8-ba6d-ff61b893d0a9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:54.980289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:55.045430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:55.051704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:55.052634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.053414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.053677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.054324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:55.054649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:55.059969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:55.069880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7d83-2cb6-4ff7-a192-88c73ca824d3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:55.080293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 370/735] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:55.085744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:55.138686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:55.139669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.140152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.140629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.141821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:55.144222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:55.183756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 366/736] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:00:54 2022] POST /identity/v3/services => generated 240 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:00:55.320990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed6cf-a56e-4353-b82d-287c5d5caa2f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:55.383163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:55.384050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.384469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.384880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.395651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:55.397436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e7f26f4c-d7db-4caf-ba81-7a0df3cbed92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:55.411886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:55.413534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:55.414619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:55.416813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 371/737] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:55.422327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:55.439926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392835-30d5-4e70-b60f-913ef495c6ac None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.440484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392835-30d5-4e70-b60f-913ef495c6ac None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.440897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392835-30d5-4e70-b60f-913ef495c6ac None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.442699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 372/738] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:55.452245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.452754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.453308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.476815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:55.478345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:55.551527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:55.586885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 373/739] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:00:55.597878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36143-f80e-4716-955c-c6448e7edc2c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:55.613213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:55.634629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:55.635242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.635519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.635790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.636548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:55.636856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:55.638294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0b002-fe5c-4be9-88c9-b81e7925184c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:55.652650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 367/740] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:55.659269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:55.679954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340fc5a-b9cc-4cdb-977d-3cf6e2c7b25a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.680292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340fc5a-b9cc-4cdb-977d-3cf6e2c7b25a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.680498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340fc5a-b9cc-4cdb-977d-3cf6e2c7b25a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.682248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 368/741] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:55.691316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680367fe-96c2-48c2-84cd-d0aff23b605d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.691647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680367fe-96c2-48c2-84cd-d0aff23b605d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.691874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680367fe-96c2-48c2-84cd-d0aff23b605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.722902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-680367fe-96c2-48c2-84cd-d0aff23b605d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:55.724096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-680367fe-96c2-48c2-84cd-d0aff23b605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:55.805498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78193157-02e3-4041-b37f-a6358ab47605 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:55.805903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 369/742] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:00:55.807249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2306a9-1568-4d03-96d5-a1d33c510898 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.807528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2306a9-1568-4d03-96d5-a1d33c510898 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.807797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2306a9-1568-4d03-96d5-a1d33c510898 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.813072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 370/743] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:55.814675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.814960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.815235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.845082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:55.845252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:55.845767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:55.846050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:55.846210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:55.846357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:55.847073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=81bce1766c4c4ed09127855dd79ec9bd) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:55.847381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:55.848807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:55.856799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 374/744] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:55 2022] GET /identity/v3/role_assignments?user.id=81bce1766c4c4ed09127855dd79ec9bd&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:55.880149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:55.938621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 371/745] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:00:55.984294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.065600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d084a-c402-4eba-8c0b-a1228d28d852 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.104478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.105023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.105297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.105568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.116626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:56.121806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:56.123971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:56.125896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 375/746] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:56.133353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.168303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.171477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.244612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddcefa-479e-4813-a831-34d678048751 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.285786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.286400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.286699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.286966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.288180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:56.288475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.291687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.300898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 372/747] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:56.301689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.328659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9dba-2e6b-4bff-a9ff-6232dae6d77b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.332011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.375328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.376367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.376781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.377176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.378092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.380298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:56.392440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:56.393674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:56.394741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 376/748] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:56.395538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.421302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.428356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7ff4-0ab8-4d1f-b932-0d85daf4f92e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.468740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.469354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.469634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.469932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.482890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:56.489273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:56.491083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 373/749] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:56.492106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.517566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574e79-d1f2-4474-a196-5bc04c3b33e7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.561278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.562153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.562707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.563145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.575359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.577039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:56.594252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:56.595489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:56.596450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:56.596450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:56.596450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:56.598243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 377/750] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:56.599399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.620325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11e1ae-8a85-40f8-b382-ccc83b64ba43 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.622994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.663739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.664351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.664631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.664898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.665624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:56.665926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.667446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.673693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 374/751] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:56.674449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.700564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.718083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265166a-c41a-4fb1-8669-1f434e4d20b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.756938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.757964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.758511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.759030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.759934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:56.760457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.762121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.771347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 378/752] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:56.772623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.793079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd1f9-7728-4f6f-96c5-d424f0a568a4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.832957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.834411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.835172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.835646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.836510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:56.837006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.838962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.855419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 375/753] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:56.856672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.881266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:56.902957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edf73-98be-4256-9505-fbbde6eac6a8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:56.941443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:56.942405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:56.942932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:56.943409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:56.944326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:56.944824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:56.946408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:56.952209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 379/754] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:56.953298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:56.974366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.002723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a3f2f-e252-4d96-8ecf-575eac6c1a89 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.043439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.044481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.044950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.045435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.057184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.059002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.073923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bf4-e473-4a92-9452-3957774928b5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:57.075402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:57.076355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:57.077247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:57.077247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:57.077247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:57.079403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 376/755] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:57.080372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.117069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.117696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.117972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.118244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.128004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.129850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:57.144795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:57.145720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:00:57.147242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:57.150556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 380/756] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:00:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:57.151602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.156776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.207272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d79e14-98b6-4776-9122-c492cae6d79c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.249387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.258692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.259395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.259744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.260084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.260847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] RBAC: Adding query filter params (interface=public, service_id=e0e50f0f25a44269af546b9f5e5a465e, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:57.261220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.261394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495b925-25a4-47bb-903d-4d5ce81eddee None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.262755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.278878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 377/757] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/endpoints?service_id=e0e50f0f25a44269af546b9f5e5a465e&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:57.279969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.299883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.300807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.301287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.301751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.302985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:57.303525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.305137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.318110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 381/758] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:57.319231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.401087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.402674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c1f6a-49c4-4fc5-a445-e34ed63bbf80 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.439505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.440462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.441004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.441509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.442455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:57.442977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.444120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35c44-a39c-40c6-9c4a-2fda9f0579ff None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.445410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.464862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 378/759] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:57.465989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.487361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.487961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.488237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.488537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.489237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.490750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.496845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 382/760] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:57.497775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.549026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.623297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527679d3-532f-4dde-9d79-7bebeff2fc96 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.654992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.664915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.665797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.666222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.666695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.678995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.680940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.689449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ca8e6-4f6a-4c6c-9e66-864544433b90 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:57.698781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:57.699970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:57.701071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:57.701071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:57.701071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:57.702577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 383/761] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:57.708570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.745101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.745827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.746102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.746368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.756752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.758869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:00:57.775817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:57.777008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:57.778325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 379/762] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:57.783740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.837077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfd2a4-b874-4828-8822-6fdb33e8da06 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.878853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.879813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.880452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.880938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.881838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:57.882347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.884317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.897652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 384/763] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:00:57.905943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:57.916041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbddb-398b-4751-a19f-fe3c5c348cef None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:57.933092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:57.973016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:57.973743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:57.974017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:57.974400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:57.975770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:57.976074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:57.977724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b9bbd-6557-428a-a500-1dff6afca4c4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:57.984406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 380/764] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83987-dfb6-42a5-aa58-8b5537a01dc0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83987-dfb6-42a5-aa58-8b5537a01dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83987-dfb6-42a5-aa58-8b5537a01dc0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 381/765] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:58.006508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83987-dfb6-42a5-aa58-8b5537a01dc0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.078500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac75f3-2703-490a-a84a-ace4963a7880 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.120152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83987-dfb6-42a5-aa58-8b5537a01dc0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.124425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.125228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.125653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.126098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.135265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.137630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-725d3e6d-e51e-4c9b-b706-d95546560df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:58.151945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:58.152919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:58.153813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 385/766] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:00:58.154898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.155174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.155442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.170449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.172089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.172579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.173397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.178449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:58.179006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:58.227125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.259020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.260746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8a42f-577d-4e6d-9d23-0f1744377b0f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.262119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 386/767] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:00:58.263412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.302459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.382343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 382/768] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:00:58.382343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f824f3-c08d-493c-b004-83f127eceb92 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.382343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f824f3-c08d-493c-b004-83f127eceb92 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.382343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f824f3-c08d-493c-b004-83f127eceb92 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.382343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 383/769] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:00:58.383328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f824f3-c08d-493c-b004-83f127eceb92 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.403982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5665-9543-4bed-850a-48c91c85b823 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.447638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.448745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.449562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.450325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.451416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:58.451957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.454165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdd21-6812-435b-9a2b-333532b12bf3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.464496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.470389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 387/770] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:58.472362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.472863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.473315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.496553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:58.497864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:00:58.504435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f824f3-c08d-493c-b004-83f127eceb92 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.551449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.553549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.554259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.554775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.571129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.573243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.575258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 388/771] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:00:58.576731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:58.600370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:58.601401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:58.602320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:58.602320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:58.602320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:58.605117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.606426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 384/772] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:58.607044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.717778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8e213-b1a4-48f3-b128-49d95d4e5476 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.720950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2143-c363-4ab0-876c-287eba0b72ff None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.753033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.754445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.755464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.756653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.757937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.760659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=6fe2a726da0f429ba1de83b2ff0ea950, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.762257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.766163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.767185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.767515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.767957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.768433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.769880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.779584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 389/773] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:00:58 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:58.780589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:58.781783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:58.783013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 385/774] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:58.784341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.788299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:58.898933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:58.917097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ed53-a389-401f-b6bb-f58c5eeb9e27 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.958245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410487c5-b47f-4082-a78e-a3ba262cffd5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:58.969292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:58.970656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:58.971506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:58.971933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:58.973024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:58.973472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:58.975865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:58.995052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 390/775] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:58.996142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.006645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.007260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.007613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.007796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.008754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.009058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.010793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.018216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 386/776] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.019213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.088802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.119572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0daa0-b937-4c1e-96b1-c16b82616f4b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.143129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fb8f3-2534-4b66-a8e5-768ef53dc353 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.157589 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.158601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.159183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.159600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.170761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.175830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:00:59.183547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:59.184630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:00:59.185603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:59.186942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.187689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.187887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.188242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 391/777] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:59.189246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.192773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.201543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.203359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:00:59.216340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:59.217395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:00:59.218562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:00:59.222376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 387/778] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:59.223583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.316776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a8dc8-4f91-456c-a953-f285b28cfc29 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.356947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686239a-f6b0-40db-97c8-c4324bbf1ddf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.362771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.363380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.363653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.363920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.364546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.364841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.366269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.376961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 392/779] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.378058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.378181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.406271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.407422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.408304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.409012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.409839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.410584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.413437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.425465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 388/780] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.426608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.457183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.499367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148ee07-26b1-45f1-86c2-da272a4cf6b8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.545953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.546590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.546876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.547144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.547822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.548124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.549546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.567447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 393/781] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.568337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.569496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab83f-0ee8-4f55-9606-005570e6976c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.622680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.623672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.624158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.624635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.626047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] RBAC: Adding query filter params (interface=public, service_id=f5de7f0cb8364c949aa4aa39e38b3188, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.626872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.629161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.638411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 389/782] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/endpoints?service_id=f5de7f0cb8364c949aa4aa39e38b3188&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.639610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.678505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e510-e805-4a83-9666-9d9803447a34 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.693290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.706275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:00:59.720607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.721567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.721980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.722515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.734872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.736925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:00:59.753222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:00:59.754134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:00:59.755045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:00:59.755045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:00:59.755045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:00:59.756959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 394/783] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:00:59.757949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.773157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eda776-7ac4-40dd-9031-ac6a1d4282b5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.817303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.817907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.818183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.818514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.819528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=bcdb2a128abf4469b6ac5a7ac9459615) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:00:59.819834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.821536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.838818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 390/784] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/role_assignments?user.id=bcdb2a128abf4469b6ac5a7ac9459615&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.840274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:00:59.881912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214754b6-ffc2-4a12-bfac-ce2f44df581a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:00:59.923080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:00:59.923850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.924129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.924405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.925014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:00:59.926403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451866f-98e4-4116-9bcf-185932c0fd0e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:00:59.934959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 395/785] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:00:59.957031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646851-8dcc-4680-8bb6-2ee33fa896a0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.957310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646851-8dcc-4680-8bb6-2ee33fa896a0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.957587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6646851-8dcc-4680-8bb6-2ee33fa896a0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.959305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 396/786] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:00:59.965247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:00:59.965517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:00:59.965790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:00:59.986193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:00:59.987434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:00.027467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.087841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 397/787] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:00:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:00.089284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578976d-ccec-4ff0-b062-99303fe15ecd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.091079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.145570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.146191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.146987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.147284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.147936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:00.148234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.149698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.170224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 391/788] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:00.175848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.285493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb48b-8b55-4def-8ec2-d31ec56ec51f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.326226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.327452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.327832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.328198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.336720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.338306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:00.350726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:00.351926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:01:00.353034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:00.354844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 398/789] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:00.363862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.464020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.515842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55884b-ade6-4e7e-963e-ac90bac2aed1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.524985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.561456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.561976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.562248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.562527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.563253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:00.563547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.564960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.600995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 392/790] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:00.606526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.635248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323306-5189-4922-9510-05be8b972ed1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.667072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.674205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.674867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.675141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.675405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.676241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.677892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:00.687939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:00.688944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:00.689982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 399/791] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:00.698240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.794828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693ef21-e6ca-4739-8894-4bbd5e61bfdb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.834773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.835323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.835598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.835864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.847551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.849277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:00.867699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:00.868691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:00.870083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:00.870083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:00.870083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:00.870083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 393/792] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:00.875079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:00.924933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:00.932987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fea66-08e5-4619-8496-e2e8cbcc6fe5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:00.978222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:00.978222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:00.978222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:00.978222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:00.978699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:00.978699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:00.978699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:00.984030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 400/793] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:00.994667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.039756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:01.095104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d861f-5800-4a1f-aad7-3c4a01d2b571 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.135178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.135778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.136048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.136326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.136953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:01.137245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.138632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0855fd-5cba-4ec8-9f30-5f816b4c5e22 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.152316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fb770-3dad-4ad1-b829-d9d49ceea8cb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.155285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 394/794] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:01.156561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a070a-d147-4b3a-ab94-5b083d733381 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.156841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a070a-d147-4b3a-ab94-5b083d733381 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.157106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a070a-d147-4b3a-ab94-5b083d733381 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.162544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 395/795] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:01.163160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a070a-d147-4b3a-ab94-5b083d733381 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.190426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.191965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.192603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.193097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.194568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:01.195087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.197027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c504-d5ac-45cb-8012-953d0113fd3f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.209100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 401/796] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Sep 19 16:01:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:01.210994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.211628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.212126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.232994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:01.235346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:01.258293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:01.274305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a070a-d147-4b3a-ab94-5b083d733381 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.312975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:01.320064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.320925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.321342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.321804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.326722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 402/797] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:01.327604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.329547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.331213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:01.343661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:01.344703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:01.345724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:01.347659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 396/798] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:01.359948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.477313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce5a-9658-482b-b10b-b71d279066e7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.516297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.516892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.517162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.517427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.518097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:01.518391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.519819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.543215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 397/799] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:01.548912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.568236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72479313-1aa4-4bfc-8e0c-db1da34d19b6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.606325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:01.628472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.629480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.629962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.630431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.631455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.633114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.658635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04883-a350-46bd-9bb2-ddb129e2be23 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.659752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 403/800] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:01.661962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:01.679383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:01.752914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.753603 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.753873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.754140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/81bce1766c4c4ed09127855dd79ec9bd/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.758351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=81bce1766c4c4ed09127855dd79ec9bd, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:01.760484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:01.777349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 398/801] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:01 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/81bce1766c4c4ed09127855dd79ec9bd/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:01:01.865288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68bec-7e56-40dd-913f-41abaaf37f69 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:01.903211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:01.903860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:01.904135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:01.904401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:01.917627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:01.923267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:01.924232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:01.925043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 404/802] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:01.933651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:02.056344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc14-3c0a-4593-a9fe-0e52612cdb9d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:02.066243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:02.094461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:02.095110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.095389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.095662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.096325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:02.096623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:02.098054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:02.107493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 399/803] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:02.115742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:02.200588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:02.244848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58102a-97c5-43fa-bfc0-95652af28428 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:02.289118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:02.289748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.290024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.290356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.301319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:02.307163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:02.326354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:02.327382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:02.328246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:02.328246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:02.328246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:02.330580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 405/804] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:02.335540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:02.482140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23ec5-84f7-4d5f-b7ac-7dec2c3f16bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:02.541404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:02.542042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.542502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.542917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.543574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:02.543876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:02.545457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541b8b-e745-46b3-b290-b2e34959422c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:02.567626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 400/805] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:02.573976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:02.709744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab4db-869c-41be-bc21-60707befd3a4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.710378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab4db-869c-41be-bc21-60707befd3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.710877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab4db-869c-41be-bc21-60707befd3a4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.712698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 401/806] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:02.717025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd2609-9da2-42ca-82f2-e80886b2cc76 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:02.718809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327a3b-d3ca-4a1b-bcb8-48127afa7253 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.719323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327a3b-d3ca-4a1b-bcb8-48127afa7253 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.719797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327a3b-d3ca-4a1b-bcb8-48127afa7253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.758346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-40327a3b-d3ca-4a1b-bcb8-48127afa7253 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:02.758858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:02.759950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-40327a3b-d3ca-4a1b-bcb8-48127afa7253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:02.787735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:02.788374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.788647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.788914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.796985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:02.797158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:02.806870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:02.828437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:02.829465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:02.830381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:02.834674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 406/807] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:01:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:02.844750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:02.965807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 402/808] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:02.968142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520d272-1e67-449b-a4a3-300cb45b9e12 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:02.972189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d35-b69f-4bca-9e77-c162031c304e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.972474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d35-b69f-4bca-9e77-c162031c304e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.972741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66d35-b69f-4bca-9e77-c162031c304e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:02.974214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 403/809] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:02.980082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:02.980355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:02.980621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.005395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.006065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.006342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.006673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.007393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:03.007691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.009449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.012007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:03.013189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:03.029543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 407/810] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:01:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:03.039581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.097352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 404/811] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:03.126846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:03.202120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcba51-ced7-4d19-9b9a-6ab874bf256d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.344343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.373077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.373693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.373988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.374248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.456534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.458656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.494621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:03.503813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:03.508343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a5169-b0be-4931-9ed0-d19a20687060 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.551004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.551624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.551930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.552584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.563946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:03.569663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:03.570634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:03.571473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 405/812] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:03.572695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.577464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 408/813] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:03.578552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.682360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1c603-0e69-4c0b-a264-178136177358 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.682576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0835-047d-4486-8305-9dffa1082437 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.722118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.722748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.723023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.723291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.723941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:03.724332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.725810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.730380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.731025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.731755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:03.732490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.732905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] PATH_INFO: `/v3/services/network` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.733889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.735573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.736360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 409/814] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:03.737334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:03.747434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:03.748627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:01:03.749572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:03.751896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 406/815] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:03.757608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.778886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:03.862769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f6e6-ad27-4111-acb7-66a76ada8102 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.879100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e15ce4-b4b1-4450-9588-72d5a023fa71 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:03.900833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.902060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.902919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.903401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.918770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.920151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:03.920786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:03.921001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.921101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:03.921316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:03.932604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:03.933978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:03.940821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:03.941781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:03.942683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:03.942683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:03.942683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:03.949418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 407/816] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:03.949418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:03.958450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:03.960028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:03.960915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:03.960915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:03.960915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:03.963914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 410/817] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:03.965007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.026448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.036708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.068126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e081ff-3ff6-4f02-b4ef-9b4ab965c231 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.096186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d013-a80a-4c1e-b64b-67ceee0a6f1c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.106059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.106959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.107412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.107857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.108754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.109228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.110902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.116005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 408/818] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:04.117032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.142959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.143751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.144093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.144577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.145278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.145949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.148252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.166658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 411/819] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:04.167878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.240259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52834b4d-4171-41b2-87ac-540d33065d0a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.276171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.284244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.285126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.285605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.286066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.286985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.287484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.289041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.302378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 409/820] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:04.303552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.308542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a9414-cba5-4f8f-b5a5-aadfbec29be9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.322274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.347805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.348407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.348674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.348937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.349610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.349904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.351283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295070d1-d978-47c8-a5c0-3704e2be4e40 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 412/821] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca290-0230-41b1-8157-80d9d1e479f8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca290-0230-41b1-8157-80d9d1e479f8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca290-0230-41b1-8157-80d9d1e479f8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 413/822] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:04.360546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ca290-0230-41b1-8157-80d9d1e479f8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.408999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4a8bd-e315-4521-b8d7-c08e70ff5f86 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.441900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.442529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.442805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.443070 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.450700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.452118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.458741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ca290-0230-41b1-8157-80d9d1e479f8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-303af740-dcb4-41f8-a871-b420255af232 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:04.463872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:04.464891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:04.465808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 410/823] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:04.466387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54915c5-7633-4d8c-af8c-c18d6c39a179 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.466387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54915c5-7633-4d8c-af8c-c18d6c39a179 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.466552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54915c5-7633-4d8c-af8c-c18d6c39a179 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.467736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 411/824] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:04.468397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54915c5-7633-4d8c-af8c-c18d6c39a179 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.495699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.496239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.496509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.496779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.503149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.504554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7468887a-0d08-47fa-a4a0-d6e2007748ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:04.516890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:04.517793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:04.518698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:04.519129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.522753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 414/825] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:04.524048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.524324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.524594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.542354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:04.543594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:04.573946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54915c5-7633-4d8c-af8c-c18d6c39a179 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.575436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.609343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.609939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.610213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.610505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.611157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.612506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edae3b-3589-4249-b4c5-2a7c8138ee04 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.613428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 415/826] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:04.614252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.645624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 412/827] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:04.647472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.648594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.649122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.675076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:04.676364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:04.760623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b025c-d5ba-43e3-b8c7-3532ef2d8fa7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.787218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 413/828] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:04.787218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.831142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.831750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.832022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.832286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.833064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.833364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.834969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.845139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.858590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 416/829] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:04.863448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:04.897548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:04.939042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d8d6d-b4a5-44d7-9a18-b0fed8ad5a40 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:04.984405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:04.985263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:04.985725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:04.985833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:04.986509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:04.986808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:04.988227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:04.988526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd5d4-902f-4377-9a87-c12795dbb4ea None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.000849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 414/830] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.001673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.031228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.031850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.032121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.032372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.042899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.044326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:05.059782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:05.060737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:05.061658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:05.061658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:05.061658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:05.061658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 417/831] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:05.061880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.104531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.113330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980515d4-53fe-407d-b569-e2c5fe01827c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.137267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.147881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.148588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.148860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.149124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.149698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.151093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:05.159605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:05.160659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:05.161466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:05.162770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1b364-0d0f-4a43-93b7-8339b769b47e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.162843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 415/832] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:05.162843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.195241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.195829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.196101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.196377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.197070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.197370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.198809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.204455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 418/833] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.205242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.272590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc782-80aa-4dca-ad43-423948014738 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.310734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.311268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.311545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.311814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.312457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.312758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.314139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.321621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9300d86-dd65-438d-9fbb-e647738575fd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.332814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 416/834] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.333539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.357736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.370094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.370763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.371040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.371309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.380270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.384123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:05.389377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:05.390469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 419/835] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:05.395449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.458723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f78c-a97e-4e81-b8b6-f94bb7264935 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.496710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.497309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.497570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.497840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.498449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.498780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.500116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.505147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 417/836] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.505771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.507560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca2940-54a9-4c40-b2b4-4ca1bfa28d00 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.545627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.546257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.546561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.546837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.553835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.555429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:05.566949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:05.567924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 420/837] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:05.568857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.600486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.620119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e984a-8583-4f2c-80f3-4e1c6ca548bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.633856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.657937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.658565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.658845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.659114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.659773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.660090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.661406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.675104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 418/838] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.675104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.684929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722bc2-3496-4351-96e7-49db71d06cfd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.721156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.721766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.722039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.722315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.722964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.723261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.724978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.738525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 421/839] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.738525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.801013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35723c4-23b9-46a6-8531-733e0aca5f78 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.846627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.847562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.847836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.848099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.848786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:05.849079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.851172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.865713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb189a-b596-4528-9041-dc7619804521 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:05.868453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 419/840] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:05.874417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:05.877168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.902924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:05.916500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:05.917150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:05.917427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:05.917699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:05.933395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:05.934892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:05.953991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:05.955196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:05.956079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:05.956079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:05.956079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:05.956861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 422/841] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:05.963003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:06.011278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed847ff-c1f8-4c1b-9435-1c748311a07a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:06.051323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:06.052242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:06.053075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:06.053308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/bcdb2a128abf4469b6ac5a7ac9459615/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:06.072716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=bcdb2a128abf4469b6ac5a7ac9459615, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:06.075134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:06.092634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41667-c247-4145-9ffd-5ac91231681c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:06.093380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 420/842] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:05 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/bcdb2a128abf4469b6ac5a7ac9459615/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:01:06.142527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:06.143072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:06.143351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:06.143622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:06.144274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:06.144572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:06.145952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:06.160419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 423/843] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:06.166576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:06.227284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:06.290979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9dfdb-2cb4-4c0a-9fad-8b477e921501 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:06.329847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:06.330662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:06.331031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:06.331392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:06.341136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:06.342728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:06.354972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:06.356144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:01:06.357318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:06.359025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 421/844] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:06.365793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:06.403468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:06.474083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc8c18-6fc9-4b68-97ea-ee08f0990c6f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:06.511728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:06.512585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:06.513011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:06.513428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:06.514371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:06.514886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:06.516470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:06.543102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:06.543521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 424/845] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Sep 19 16:01:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:06.656757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf332-5990-4fab-a9bd-7161d08a7c2e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:06.674848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:06.699111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:06.699897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:06.700283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:06.700660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:06.770826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:06.773008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:06.876458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 422/846] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:06.883113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:06.986299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:06.994909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541e478-d587-47d1-851c-6bb05762bdeb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.031838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.032820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.033292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.033775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.044874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.046616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:07.063746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:07.064729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:07.065589 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:07.065589 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:07.065589 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:07.067669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 425/847] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:07.073969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:07.092834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:07.184882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a9d1-3460-46ba-a2cb-bebd273ef58f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.220063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.220660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.220934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.221204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.221834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:07.222128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.223519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631f02-99fd-47c5-88cf-201415332d72 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.235715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 423/848] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:07.242310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:07.356702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67cb11-ab4e-4b39-bdd4-10505a01be0d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.393215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.393876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.394103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.394345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.402079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.403540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:07.415403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:07.416305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:07.417175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:07.417593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b39-1c4c-41ed-b442-9984c4d505f6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.417664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 426/849] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:07.417731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b39-1c4c-41ed-b442-9984c4d505f6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.417731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8b39-1c4c-41ed-b442-9984c4d505f6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.418739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 424/850] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:07.422241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:07.424089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.424571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.425041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.432135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:07.443922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:07.445214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:07.520846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 425/851] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:07.534188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3526752-3471-4582-b57d-fd0d5489dc97 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.571172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.572043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.572459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.572868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.573682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:07.574120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.575734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.588603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 427/852] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:07.594757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:07.597440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:07.706917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673b09-cda6-4d94-96c5-a8f495aa0889 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.745842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.746458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.746971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.747349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.748113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=81bce1766c4c4ed09127855dd79ec9bd) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:07.748430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.749865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.756994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 426/853] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/role_assignments?user.id=81bce1766c4c4ed09127855dd79ec9bd&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:07.791259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:07.872390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:07.915756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffc8fa-41d6-45a5-bf5c-8b7aa2f8e18e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:07.954494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:07.956032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:07.956032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:07.956032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:07.956270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:07.957628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-73e7c425-5a77-4168-a634-0f2ac92bafb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:07.967030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:07.967982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:07.969047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 428/854] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:07.974145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:08.010718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949421-17ba-4578-bb48-4be06995f067 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.011046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949421-17ba-4578-bb48-4be06995f067 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.011269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949421-17ba-4578-bb48-4be06995f067 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.012868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 429/855] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:08.018265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.018570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.018846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.043383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:08.044490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:08.050866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:08.096140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7961-6b54-42a5-9137-74c4d9efc0d6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:08.133788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:08.134669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.135131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.135646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.138525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 430/856] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:08.142727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:08.143056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:08.150536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:08.155140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 427/857] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:08.160378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:08.222665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:08.265185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be33e7-9f52-4bfe-b736-9ba9856cb0f4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:08.300900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:08.301419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.301687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.301949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.303418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:08.303712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:08.305167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9952-507b-495c-bef9-12b75f5f4adb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:08.310060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 431/858] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:08.409573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:08.506101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e5c6-764b-497e-bf6d-e2e53d2ce196 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.506635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e5c6-764b-497e-bf6d-e2e53d2ce196 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.506740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e5c6-764b-497e-bf6d-e2e53d2ce196 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.507998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 432/859] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:08.513128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.513646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.514136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.519931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50659855-b586-4f4d-a800-8ef8e35f4d2b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:08.538844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:08.540376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:08.554070 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:08.561865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:08.562469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:08.562765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:08.563031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:08.563673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:08.565140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:08.589646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 428/860] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:08 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:08.628969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 433/861] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:09.049451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:09.158331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d54a-5215-4d65-9dea-8a01ff7ee04b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:09.195611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:09.196632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:09.197137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:09.197601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:09.208740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:09.214392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:09.215342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:01:09.216173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:09.222755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 429/862] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:09.227547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:09.280560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:09.333994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e1566-fc47-4e8b-9baf-c889bafa40b4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:09.370872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:09.371494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:09.371764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:09.372029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:09.372704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:09.372997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:09.374404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:09.384873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 434/863] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:09.390584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:09.444560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:09.498797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ed3e1-fdf0-4104-9bcd-75340a887050 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:09.536636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:09.538155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:09.538659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:09.539202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:09.550177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:09.552229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:09.567427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:09.568478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:09.569389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:09.569389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:09.569389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:09.571491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 430/864] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:09.577338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:09.682398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0672e-d721-4156-bbbd-308672758a29 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:09.695937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:09.717763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:09.718364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:09.718666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:09.718932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:09.719562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:09.719857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:09.721213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:09.733875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 435/865] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:09.740140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:09.846448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073a14e-c308-47b4-9a78-c2641fe0d42f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:09.848272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:09.883279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:09.884362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:09.884840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:09.885305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:09.893341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:09.895105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:09.906910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:09.907899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:09.908830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:09.911333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 431/866] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:09.917146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.026431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b212d4-5383-42e9-ab62-756a5c3c34fc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.061309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.061908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.062180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.062440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.063188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:10.063486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.064898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef69f-a5ca-40d3-80e0-d76b03ba1f9b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.083253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 436/867] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:10.091825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.104667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299576a9-f8f9-4d23-90c3-75af16313a03 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.104951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299576a9-f8f9-4d23-90c3-75af16313a03 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.105209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299576a9-f8f9-4d23-90c3-75af16313a03 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.106844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 437/868] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:10.111702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.112069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.112264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.133152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:10.133950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:10.164301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.204186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd37c-312f-4a84-989d-ab27861d397f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.226636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 438/869] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:10.244991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.245914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.246395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.246901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.279254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.320946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.322845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.439010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 432/870] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:10.445307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.536255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.547231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073f933-360e-4382-8839-e152ef0d5e05 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.587490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.588177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.588410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.588749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.600050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.601606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.609559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:10.619559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:10.620586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:10.621543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:10.621543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:10.621543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:10.621543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 439/871] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:10.627384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.645087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.654163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6585b8e-81ea-468c-9939-f133f969d590 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.692520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.693761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.694139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.694401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.695174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.696572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-fc8191f6-4199-4a73-b57c-b6ca454cbe5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:10.705893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:10.707416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:10.708947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:10.712538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 433/872] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:10.712730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef1cb-fb67-4096-9fc3-833ac14cd609 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.713257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef1cb-fb67-4096-9fc3-833ac14cd609 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.713659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ef1cb-fb67-4096-9fc3-833ac14cd609 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.715224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 434/873] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:10.719292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ef1cb-fb67-4096-9fc3-833ac14cd609 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.752105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b8eb-e7c0-4fc2-bb49-f5805254ebaa None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.788214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.789087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.789547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.789992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.790938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:10.791483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.793192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6019d3-9eb1-4774-b2d5-ae234b93cb35 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.808374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 440/874] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:10.810005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.810510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.810957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.831104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:10.832611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:10.837366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ef1cb-fb67-4096-9fc3-833ac14cd609 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:10.863702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.874285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:10.875701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:10.875980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:10.876249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:10.876867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:10.877165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:10.878578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:10.889752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 435/875] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:10.889752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.914644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 441/876] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:10.914644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:10.914912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:10.998374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10780-b3ab-466e-9479-2ae3884b68bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.020594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f388f3c-d872-4e68-8ef8-afb303a070bd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.036026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.036651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.037467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.037730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.045751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.047168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.056524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.057125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.057406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.057675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.058293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:11.058625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.059969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36a217-3ab1-4df5-947f-bd5e365e5d45 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-607170e0-365d-4719-b4b8-ebbdce0da63d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:11.060301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:11.061126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:11.062036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 436/877] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:11.063229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e148a4-460e-461f-ae89-45ee632e2af4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.063503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e148a4-460e-461f-ae89-45ee632e2af4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.063766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e148a4-460e-461f-ae89-45ee632e2af4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.066609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 437/878] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:11.067525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e148a4-460e-461f-ae89-45ee632e2af4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.071974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 442/879] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:11.073533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.074058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.074614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.094023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:11.095736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:11.127619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.181294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.189398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e148a4-460e-461f-ae89-45ee632e2af4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.191239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 443/880] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:11.200331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.233408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.234527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.234854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.235127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.236208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:11.236522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.237964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.253697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 438/881] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:11.262671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.338315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e0d7-5d2f-43cb-9eed-ab125343f605 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.382515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.383399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.383858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.384280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.385215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.386959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.388577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bf16e-a986-4d71-97a9-98251d16201b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.403570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.407702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 444/882] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:11 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:11.441106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.442161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.442775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.443323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.444283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=bcdb2a128abf4469b6ac5a7ac9459615) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:11.444804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.446628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.454403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 439/883] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:11 2022] GET /identity/v3/role_assignments?user.id=bcdb2a128abf4469b6ac5a7ac9459615&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:11.475655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.547340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.611179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a551-7a77-484c-ac9d-fd202d72dbf8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.649776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.650403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.650702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.650993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.651567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.652925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:11.662596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:11.663623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:11.665129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 445/884] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:11.669854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.779396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07308aa7-70ed-4b10-a44d-ac606050dc21 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.815800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.816406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.816681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.816949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.817574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:11.817871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.819837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.825896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:11.831536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:11.946602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493421-55e6-43e1-afc5-38f460d5f829 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:11.968834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:11.987022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:11.987632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:11.987909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:11.988235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:11.988866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:11.989222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:11.990709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:11.996035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 446/886] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:12.001852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:12.045933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:12.118050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f73d1f-66c1-4cbb-b6be-4eb9cf6a163b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:12.157126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:12.158536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:12.159021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:12.159583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:12.160464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] RBAC: Adding query filter params (interface=public, service_id=c09b7c8446e04918b69e753c0b9085ca, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:12.160969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:12.163086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7ec4b-c332-4612-988b-044d0a54cb31 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:12.169026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 441/887] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:01:12 2022] GET /identity/v3/endpoints?service_id=c09b7c8446e04918b69e753c0b9085ca&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:12.174581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:12.277967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93091-4530-437b-8dae-9140c8c4a055 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:12.313776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:12.314390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:12.314698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:12.314972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:12.315575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:12.317018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f20bd-0075-4043-b4a6-e2eae01c4382 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:12.330668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 447/888] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:12 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:01:13.368867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fcb4-0b02-4b51-a5e0-f202146433c2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.369363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fcb4-0b02-4b51-a5e0-f202146433c2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.369441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346fcb4-0b02-4b51-a5e0-f202146433c2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.370994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 442/889] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:13.376334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcae24-91e1-4955-95f5-3245afa49f23 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.376741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcae24-91e1-4955-95f5-3245afa49f23 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.376906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcae24-91e1-4955-95f5-3245afa49f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.396682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4cdcae24-91e1-4955-95f5-3245afa49f23 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:13.397873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4cdcae24-91e1-4955-95f5-3245afa49f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:13.449512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:13.476471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 448/890] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:13.697034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610cec-c913-483d-b0b1-2f91222919de None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.697376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610cec-c913-483d-b0b1-2f91222919de None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.697558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610cec-c913-483d-b0b1-2f91222919de None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.699091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 443/891] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:13.704295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2f20-81c5-4e2f-933a-d8373e1a225b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.704821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2f20-81c5-4e2f-933a-d8373e1a225b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.705299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2f20-81c5-4e2f-933a-d8373e1a225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.724207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-41ad2f20-81c5-4e2f-933a-d8373e1a225b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:13.725717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-41ad2f20-81c5-4e2f-933a-d8373e1a225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:13.752383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81610cec-c913-483d-b0b1-2f91222919de None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:13.810521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 449/892] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:13.870547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:13.875592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81610cec-c913-483d-b0b1-2f91222919de None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:13.888777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78054cc-651d-4f57-a882-de330b02e574 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.889055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78054cc-651d-4f57-a882-de330b02e574 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.889324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78054cc-651d-4f57-a882-de330b02e574 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.890930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 450/893] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:13.895630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.895917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.896196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.910730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:13.911324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:13.911623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:13.911893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:13.912530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:13.913879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:13.914008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:13.915166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:13.931460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 444/894] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:13 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:01:14.007420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 451/895] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:14.103088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.208935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379e58-0e99-436c-ad4f-057e5b761d50 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.244336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.244961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.245230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.245491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.246060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.247443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:14.256705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:14.257745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:14.258700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 445/896] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:14.263950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.275873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.300884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.306377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.389797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e87e1-bfa0-4b0c-b515-24094b6f0f82 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.407975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699501b6-6fd7-4d8f-ba70-ef19109798e5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.426461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.427533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.427990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.428256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.428975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:14.429512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.430906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.441280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 452/897] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:14.442184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.458004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.459886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.460581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.461021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.476983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:14.484437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:14.485587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:14.486637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:14.494591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 446/898] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:14.495866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.562065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.567027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abee1ad-9cc4-4fcd-8234-aad9c45f5e1b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.596496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.608348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.609284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.609707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.610114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.610914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:14.611383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.613028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43208eea-a49c-4e13-b6ff-3074e4f1d41d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.618542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb96d5-6133-40a3-98d4-c9900150c691 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.618771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 453/899] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:14.620055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561417-cf1a-4e5f-8851-17a6d17813b7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.620567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561417-cf1a-4e5f-8851-17a6d17813b7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.620987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561417-cf1a-4e5f-8851-17a6d17813b7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.622677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 454/900] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:14.624959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45561417-cf1a-4e5f-8851-17a6d17813b7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.656026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.656632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.656908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.657179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.657828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:14.658129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.659535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af61c-348d-4a2f-bd84-9e18d7089b51 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.668379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 447/901] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:14.669559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.669842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.670117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.689043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:14.690232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:14.739564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45561417-cf1a-4e5f-8851-17a6d17813b7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.770390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 448/902] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:14.775247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.775455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.776235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.776714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.777165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.778036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] RBAC: Adding query filter params (interface=public, service_id=d16f82fb4f2d4fd49f57768a8ba3c7fc, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:14.778546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.780082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.788360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 455/903] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/endpoints?service_id=d16f82fb4f2d4fd49f57768a8ba3c7fc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:14.794462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.834530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.866499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:14.898939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49128d5-db8d-425a-bfcd-ad6eb6cd2176 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.939333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3080-7698-4643-87b6-5fbb27205b88 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:14.941851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.943266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.943763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.944241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.955819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.957575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:14.973424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:14.974419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:14.975339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:14.975339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:14.975339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:14.977406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 449/904] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:14.986351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:14.986539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:14.986624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:14.986624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:14.986624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:14.986624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:14.986624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:14.994594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 456/905] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:01:15.041896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.111976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304ce78-51a0-4b2f-a4a6-fcbf8c0f0679 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.144547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.155793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.156004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.156881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.157396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.157961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.158875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:15.159779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.161369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.169563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124b0e-2bc7-47d2-846d-0e177f0bbe62 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.176314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 450/906] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:15.183078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.213939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.214707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.214977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.215238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.215822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.217174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:15.227291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:15.228305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:15.229457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 457/907] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:15.234429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.305703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ee4f-9a10-4a22-b8ad-7fbee2a1e618 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.350335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.351370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.351794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.352222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.361612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.363732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.371004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bb86-d152-41be-86e5-4b6b6b5eda24 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:15.379256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:15.381005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:15.382089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:15.384563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 451/908] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:15.390850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.420578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.422547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.423011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.423459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.424944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:15.425548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.428261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.435643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 458/909] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:15.441130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.451637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.464186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.524264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271286f7-a67c-422e-8f89-3f6b40d85381 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.549720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fb5c-0109-4476-b15b-7a34f2a16a34 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.566452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.567654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.568178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.568649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.569714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:15.570199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.571832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.591230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.591844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.592119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.592384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.593006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:15.593356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.593804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 452/910] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:15.600657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.600657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 459/911] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:15.602072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.608766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:15.702870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.706973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff433221-b619-4e70-b4d8-8a659927e1dd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.709335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:15.726962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c944ebe-1c62-4cce-b74c-ae7563dc02f9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:15.742943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.743541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.743808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.744070 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.767830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:15.769147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:15.769620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:15.770077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:15.771013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.772833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.800215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 460/912] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:01:15.829855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:15.831363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:15.944086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 453/913] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:15.951911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.073564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29db2-5439-458a-9e8a-d003ca8268d1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.123590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.124227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.124504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.124776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.126753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:16.137242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.138782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5a3bd19e-27d4-4f69-9d61-34ae7bbdabd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:16.155438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:16.156429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:16.157588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:16.157588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:16.157588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:16.157588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 461/914] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:16.163298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.166429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:16.218812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540df-4051-4ac5-bbaa-bf30b8a3131b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.219080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540df-4051-4ac5-bbaa-bf30b8a3131b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.219354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540df-4051-4ac5-bbaa-bf30b8a3131b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.220932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 462/915] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:16.226025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.226439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.226753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.246314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:16.247622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:16.268448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993bfd2-074a-4430-bc43-70d7f1b10bc7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.304695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.305289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.305558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.305824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.306452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:16.306774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.308131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.321492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 454/916] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:16.327141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.342568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 463/917] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:16.408021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:16.451299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690f6b9-034b-431f-8ee9-30b0e8720689 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.486729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.487466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.487643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.487909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.494674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.496095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:16.507853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:16.509896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:16.512082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 455/918] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:16.518519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.610667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.635551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6092fb-402c-409d-8f8c-3b8d2eff3cb8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.654862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:16.674139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.674774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.675048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.675440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.676136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:16.676438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.678704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.692069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 464/919] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:16.699162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.734114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf3665-9517-47e6-ba7f-df3cf919cb57 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.760720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:16.773907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.774880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.775000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.775181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.775756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.777119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:16.788235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:16.789469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:16.790525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:16.794690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 456/920] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:16.796106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:16.823680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1d3d-e70b-4ac1-b331-a22adc471113 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.859780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.860381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.860653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.860972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.861673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] RBAC: Adding query filter params (role.id=a15dae68603144eeb11a7d73681855f1, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=bcdb2a128abf4469b6ac5a7ac9459615) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:16.861926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.863462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.874839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 465/921] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/role_assignments?user.id=bcdb2a128abf4469b6ac5a7ac9459615&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=a15dae68603144eeb11a7d73681855f1 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:16.921451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1125d-7755-4dcc-917a-c6729b846024 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:16.961401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:16.962399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:16.962925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:16.963409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:16.964256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:16.964763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:16.966433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:16.972652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 457/922] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:16.979275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:17.026572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:17.096842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064b620-47ff-472f-96ad-94c26d2b695f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:17.132448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:17.133480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.133950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.134418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.135284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:17.135786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:17.137347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:17.142869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 466/923] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:17.148881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:17.213405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:17.258329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de41c-c2fc-4659-a7f7-2d7791d45440 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:17.293594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:17.294465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.294902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.295306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.296127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] RBAC: Adding query filter params (interface=public, service_id=1680c4558bf5492aa8e291fe78ca935d, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:17.296568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:17.298072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfc5af-e9d7-4816-99d9-16fc76901203 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:17.304332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 458/924] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:01:17 2022] GET /identity/v3/endpoints?service_id=1680c4558bf5492aa8e291fe78ca935d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:17.310088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:17.349916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092750-2d25-425e-b2ef-b545e5daa648 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.350229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092750-2d25-425e-b2ef-b545e5daa648 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.350455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092750-2d25-425e-b2ef-b545e5daa648 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.351939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 459/925] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:17.360791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.361064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.361338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.382846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:17.384593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:17.436232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58917f86-647d-496c-8664-29560b1c23d1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:17.439423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:17.463746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 460/926] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:17.490213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:17.491257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.491729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.492194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.492986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:17.494585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:17.501227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 467/927] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:17 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:01:17.739341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:17.788158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:17.852965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84499-0add-4117-a44b-2d7a8c9648e3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:17.889110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:17.889738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:17.890015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:17.890281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:17.890890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:17.892236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:17.901027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:17.901948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:17.902870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 461/928] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Sep 19 16:01:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:17.910234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.023649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e6a6-3353-49bc-8534-808074292520 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:18.060461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:18.061427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.061952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.062428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.063374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:18.063890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:18.065461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67a73c-d674-49b0-90c8-6c0438ddcb4c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:18.071252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 468/929] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:18.077223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.101662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7dc75-8bcd-41d5-8dac-1165ca39f7fa None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.102203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7dc75-8bcd-41d5-8dac-1165ca39f7fa None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.102669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7dc75-8bcd-41d5-8dac-1165ca39f7fa None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.104416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 469/930] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:18.109449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.109887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.110331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.130715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:18.132270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:18.160056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:18.196139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5b1e-7e6a-4d9f-b7d1-379741a6c793 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:18.205750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 470/931] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:18.214929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:18.234551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:18.235400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.235821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.236339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.237176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:18.237649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:18.239208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:18.246117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 462/932] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:18.251925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.363563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d130f3-481c-4ea8-a31f-a6412bed115c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:18.405473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:18.406083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.406356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.406680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.407344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:18.408715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:18.431695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 471/933] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:18.493339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.608359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9663c68-0bcb-4505-96bf-6a4151b55f91 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:18.651821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:18.652427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.652699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.652963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.653596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:18.655045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:18.657647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING keystone.server.flask.common [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 16:01:18.680491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.sql.core [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:01:18.680491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 16:01:18.680491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [parameters: {'id': '65c98c88590544b3a9fdee5c6fa13d32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 16:01:18.680491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81559) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65c98c88590544b3a9fdee5c6fa13d32.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65c98c88590544b3a9fdee5c6fa13d32. Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:01:18.687611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 16:01:18.688395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application yield resource Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise self.value Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application session.commit() Sep 19 16:01:18.689423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:01:18.690316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:01:18.691336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:01:18.692142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [parameters: {'id': '65c98c88590544b3a9fdee5c6fa13d32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:18.693571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:18.694349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 65c98c88590544b3a9fdee5c6fa13d32. Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:18.697420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 463/934] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Sep 19 16:01:18 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:18.698820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.720820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:18.809389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258dd5-c1c7-4446-8583-f4898a6d000e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:18.848600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:18.849280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:18.849551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:18.849814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:18.859657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:18.861455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c1d4b42a-9585-4a08-8154-09b5ff80331b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:18.873918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:18.874824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:18.875695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:18.877973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 472/935] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:18.886656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:18.916186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:18.994699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d928925-6534-402e-b78f-0a07b5df478b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:19.032065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:19.033016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.033486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.033965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.034860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:19.035424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:19.037444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29864e37-a09e-4d12-975e-fbb3260c0336 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:19.059073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 464/936] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:19.202344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef718ac-57e0-4722-b3f3-4b404282fb06 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.202873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef718ac-57e0-4722-b3f3-4b404282fb06 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.202873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef718ac-57e0-4722-b3f3-4b404282fb06 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.204404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 473/937] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:19.210006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.210703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.211223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.232570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:19.234476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:19.306733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 465/938] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:19.573175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef718ac-57e0-4722-b3f3-4b404282fb06 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:19.656714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:19.683917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef718ac-57e0-4722-b3f3-4b404282fb06 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:19.719812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:19.720436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.720763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.721037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.732799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e47bc0ff-0e9b-492a-b24e-bf14e096bd37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:19.737652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:19.738581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:19.739415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 474/939] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:19.746588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:19.780160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aeedd-8512-4356-94d6-86f21e7fbe44 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.780892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aeedd-8512-4356-94d6-86f21e7fbe44 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.781384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363aeedd-8512-4356-94d6-86f21e7fbe44 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.783185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 475/940] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:19.787305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:19.789694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.790295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.790866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.810745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:19.812365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:19.866975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3e0e-b214-4897-a0fb-f4a6e507ceab None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:19.909307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:19.910428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 476/941] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:19.910978 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:19.912020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:19.912481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:19.913349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:19.913837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:19.915429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:19.924599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 466/942] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:19.930902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.003664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.050700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce8a9a-6ffb-4e3f-a911-9bd580f097cf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.087811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.088442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.088717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.088986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.099598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.101112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:20.116190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:20.117220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:20.118133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:20.118133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:20.118133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:20.118133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 477/943] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:20.124769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.206502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.209555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.234137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d01f45-4bd6-48ec-8fbe-53533ebb6ac7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.271562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.272746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.273433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.273844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.274649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:20.275103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.276674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.291668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 467/944] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:20.299310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.325363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0492f-0b20-4e23-97cc-f500d418a2e3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.354496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.372053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.372611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.372884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.373149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.373763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.375108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:20.383960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:20.384956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:20.385771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 478/945] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:20.391403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.422261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c582c9-616c-432d-9dfc-0b47ebb22189 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.457826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.459026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.459270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.459532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.467599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.469084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.471041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:20.483504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:20.484666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:20.485767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:20.489150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 468/946] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:20.490065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.541435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725e77-f647-414e-8868-bbc2dc904600 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.593216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.594721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.595143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.595627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.596364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42bbf8-7916-4007-85d8-b835d69b2db3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.596535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:20.596964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.599659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.606270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 479/947] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:20.611985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.635265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.635806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.636091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.636340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.637283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:20.637397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.638842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.660281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 469/948] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:20.668033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.680754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.728747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.750696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136310-a7a2-4d4e-90f7-0f2bece59abe None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.777199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2040b50-d160-4141-98c8-07a9ad040725 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.784741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.785342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.785614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.785881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.787054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:20.787347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.788699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c6cb-5f61-495c-a4ec-0630f5c146ba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.793841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 480/949] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:20.795029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094c4-3c1f-47a9-9b87-347b7d9ba275 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.795305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094c4-3c1f-47a9-9b87-347b7d9ba275 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.795571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094c4-3c1f-47a9-9b87-347b7d9ba275 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.796871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 481/950] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:20.801494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e094c4-3c1f-47a9-9b87-347b7d9ba275 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.821269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.822171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.822657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.823225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.834523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.836064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f32d2cbd-cf5a-4d10-9467-ee71845729e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:20.852656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:20.853633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:20.855123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:20.855123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:20.855123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:20.855123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 470/951] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:20.855365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.855588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.855791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.873918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:20.875121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:20.913438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e094c4-3c1f-47a9-9b87-347b7d9ba275 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:20.927965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:20.945899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 471/952] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:20.946750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:20.959970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:20.961025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:20.961863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:20.962309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:20.963394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:20.965408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:20.988553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:21.002523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 482/953] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:21.069275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf1c92-1c35-4298-ab91-c2a1b10d7410 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.117607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.118228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.118735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.119101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.119744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:21.120041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.121425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.135252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 472/954] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:21.140811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.235727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.255257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6b83-f807-421b-ac7b-d8daaf3c3a08 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.296283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.297319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.297740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.298150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.306251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.308048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:21.320326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:21.321414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:21.322581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:21.329244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 483/955] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:21.330348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.349973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:21.358376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0df7b8-37a6-4cda-b003-fa5dac7caf7d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.366034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:21.401401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.402595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.402940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.403216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.403796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.405158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4a9d91c3-d664-4041-9a5e-f80eb26b8879 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:21.415349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:21.416438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:21.417267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 473/956] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:21.418059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83312-6821-4592-8c20-059259d2fafe None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.418059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83312-6821-4592-8c20-059259d2fafe None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.418729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83312-6821-4592-8c20-059259d2fafe None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.419739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 474/957] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:21.422630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83312-6821-4592-8c20-059259d2fafe None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.448979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c577b4-f8b3-46d6-b7a9-a1f9d00aa4e2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.484096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.484699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.484971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.485278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.485997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:21.486243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.487699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52aeb-ea3d-4e06-95cb-01076a8677f1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.504782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 484/958] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:21.506388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.506690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.506957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.524826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:21.525990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:21.531056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83312-6821-4592-8c20-059259d2fafe None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.566343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.566974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.567252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.568041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.568678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:21.568972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.570403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.578529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 475/959] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:21.578529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.601136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 485/960] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:21.601980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.606933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:21.634230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:21.713515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218370f-2935-4925-94fe-758fdaae977f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.727518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5681-21b2-4df1-8814-6bfee088f18a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:21.762742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.764305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.764844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.765382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/bcdb2a128abf4469b6ac5a7ac9459615/roles/a15dae68603144eeb11a7d73681855f1` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.767779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=bcdb2a128abf4469b6ac5a7ac9459615, role_id=a15dae68603144eeb11a7d73681855f1)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.769087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:21.769546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.769878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:21.770252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:21.770787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:21.771945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:21.772344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:21.773902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:21.786803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 486/961] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:21.793540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 476/962] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:21 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/bcdb2a128abf4469b6ac5a7ac9459615/roles/a15dae68603144eeb11a7d73681855f1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:01:21.884137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:21.983140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:22.006745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065d64-2808-4ee7-a79f-8e44b0ad838b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:22.045760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:22.046384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:22.046683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:22.046959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:22.047602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:22.049036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:22.051630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING keystone.server.flask.common [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 16:01:22.065675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.sql.core [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:01:22.065675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 16:01:22.065675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [parameters: {'user_id': 'f269738f4e20404591aae33ad304f993', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 16:01:22.065675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81558) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Sep 19 16:01:22.084832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:01:22.085756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application yield resource Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise self.value Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application session.commit() Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:01:22.086815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:01:22.087686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:01:22.088590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:01:22.089488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f269738f4e20404591aae33ad304f993', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:22.090312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 16:01:22.093270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:22.102168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 487/963] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Sep 19 16:01:21 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:22.102696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:22.193206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:22.215408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4782e08-e054-4910-b18a-7323158bbe7f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:22.250640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:22.251568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:22.251992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:22.252409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:22.261110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:22.262783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f142bd20-cccb-475d-ba9a-aa89f045c22b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:22.275455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:22.276582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:01:22.277764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:22.279966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 477/964] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:22.286184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:22.405717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bb96b-1faf-418f-9d93-2fb2ddd888f5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:22.442270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:22.443478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:22.443750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:22.444019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:22.444700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:22.445049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:22.446708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaa20f-db56-411d-8d4e-b68e8247fc12 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:22.484964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 488/965] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Sep 19 16:01:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:23.270229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce69-f9b1-40bd-8da5-547c6e3c345d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:23.270806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce69-f9b1-40bd-8da5-547c6e3c345d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:23.270885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce69-f9b1-40bd-8da5-547c6e3c345d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:23.272705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 478/966] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:23.278401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:23.278722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:23.279000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:23.285468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:23.298314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:23.299865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:23.368640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 489/967] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:23.649895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ce69-f9b1-40bd-8da5-547c6e3c345d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:23.751281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ce69-f9b1-40bd-8da5-547c6e3c345d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:23.783530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:23.784145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:23.784418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:23.784684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:23.785255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:23.787168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:23.795839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:23.796836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:23.797718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:23.805846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 479/968] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:23.805983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:23.912775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356528b8-666b-4f85-89a0-40f894c091a4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:23.947080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:23.953575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:23.954743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:23.955435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:23.955712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:23.956370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:23.956674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:23.958155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56c161-999d-46c2-83d9-96789f5dd069 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:23.968702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 490/969] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:23.969957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:23.980997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:24.020132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4603-4a28-491e-81a8-d78ad60b61b2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.020446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4603-4a28-491e-81a8-d78ad60b61b2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.020707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4603-4a28-491e-81a8-d78ad60b61b2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.022171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 491/970] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:24.027048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd7b4-764e-47fc-8e60-78a7395274b6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.027326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd7b4-764e-47fc-8e60-78a7395274b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.027596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd7b4-764e-47fc-8e60-78a7395274b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.046342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5cbdd7b4-764e-47fc-8e60-78a7395274b6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:24.047675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5cbdd7b4-764e-47fc-8e60-78a7395274b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:24.082458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115c56e-db88-4d66-8d68-e0b78c4ad2ca None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.116096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 492/971] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:24.116355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.117008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.117282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.117405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfa9d-31a3-4142-98ef-0dcd0bdd2d9c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.117569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.117670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfa9d-31a3-4142-98ef-0dcd0bdd2d9c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.117932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfa9d-31a3-4142-98ef-0dcd0bdd2d9c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.118158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:24.118454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:24.119342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 493/972] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:24.119826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:24.124658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.124934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.125162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.130619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 480/973] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:24.132136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.146636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:24.148587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:24.217468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:24.226798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 494/974] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:24.249157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53581d37-f1e8-40bf-bf78-5213ec5a3a0d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.283507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.284117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.284362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.284619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.285305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] RBAC: Adding query filter params (interface=admin, service_id=1680c4558bf5492aa8e291fe78ca935d, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:24.285604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:24.287679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:24.292906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 481/975] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Sep 19 16:01:24 2022] GET /identity/v3/endpoints?service_id=1680c4558bf5492aa8e291fe78ca935d&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:24.298398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.363165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:24.382529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.408606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb504c5-cfe4-496c-8fa6-f6cb5594ba59 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.445695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.446327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.446709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.447037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.447758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:24.449114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:24.455479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 495/976] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:24 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:01:24.487843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69672af7-22e1-4c6a-972b-f5c360e7ebf5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.491737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.527147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.527992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.528274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.528545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.529218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:24.530651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:24.534428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:24.547671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 482/977] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:24 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:01:24.616364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5836e-7e23-4cb7-80e9-ca3d5fb3e3ca None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.640344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:24.666650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.667355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.667631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.667929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.680405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:24.685466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:24.686466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:24.687634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:24.690592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 496/978] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:24.693704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.806125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ac5a-706b-4ac7-b674-2083e5a481b2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.841433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.842043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.842320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.842619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:24.843277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:24.843578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:24.844938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:24.855174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 483/979] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:24.861646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:24.963681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb31e10-007f-4c8a-9e67-f9c49807d973 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:24.998521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:24.999135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:24.999410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:24.999679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:25.010814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:25.012571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:25.027753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:25.028712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:25.029631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:25.029631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:25.029631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:25.029631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 497/980] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:25.034519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:25.094515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:25.142028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c8df-d1d7-4d0a-8472-ba28e4771e6c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:25.176334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:25.177494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:25.177767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:25.178035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:25.178690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:25.178987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:25.180341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:25.193859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 484/981] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:25.198671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:25.228199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:25.302448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e41aa-41cc-44cf-b56f-79f471814869 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:25.341829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:25.342782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:25.343243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:25.343728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:25.352456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:25.354230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:25.369440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:25.370504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:25.371794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 498/982] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:01:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:25.378466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:25.486755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb28a-f78e-45ed-a540-7b2bcc694562 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:25.503866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:25.522296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:25.522943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:25.523221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:25.523495 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:25.524210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:25.524513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:25.525927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:25.546600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 485/983] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Sep 19 16:01:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:25.549170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:25.640168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:25.653756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498a3c-8fca-4909-8c57-9ff39839b7b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:25.688205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:25.688803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:25.689080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:25.689345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:25.756264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:25.757722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:25.844542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:25.862905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 499/984] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:25 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:01:25.864521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:25.968570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517bd3-0dcc-499c-9ba6-020a68a3e135 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:26.001190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:26.001800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.002069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.002333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.012977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:26.014406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:26.028833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:26.029809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:26.031220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:26.031220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:26.031220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:26.034519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 486/985] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:26.035717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:26.133308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ff52-746c-482c-a8f0-71e7174dec1b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:26.167587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:26.168188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.168460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.168724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.169350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:26.169640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:26.171027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:26.185386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 500/986] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:26.190790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:26.219008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:26.293446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653e07e-89a7-4c0c-9a84-8549bc55b005 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:26.327483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:26.328108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.328379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.328643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.339000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:26.340413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:26.355711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:26.356664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:26.357633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:26.358966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 487/987] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:26.359857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:26.411803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:26.464069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a0c20-6519-4b92-836b-07bf4bc85bd2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:26.505922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76553e61-5854-4255-9999-ae05574087cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:26.506444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553e61-5854-4255-9999-ae05574087cb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.506750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553e61-5854-4255-9999-ae05574087cb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.507021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76553e61-5854-4255-9999-ae05574087cb None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.507704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76553e61-5854-4255-9999-ae05574087cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:26.508005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76553e61-5854-4255-9999-ae05574087cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:26.509464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76553e61-5854-4255-9999-ae05574087cb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:26.527002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 501/988] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:26.528552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:26.622292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:26.638814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f94d6-98d6-43f0-ab3e-827db4ad1978 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:26.647621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33da9b-aed3-41c1-8f69-afde494cd7a7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.647950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33da9b-aed3-41c1-8f69-afde494cd7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.648169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33da9b-aed3-41c1-8f69-afde494cd7a7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.649707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 502/989] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:26.655563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f647a-39f1-4c67-b358-0551442df9c4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.655839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f647a-39f1-4c67-b358-0551442df9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.656107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f647a-39f1-4c67-b358-0551442df9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.674969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fa1f647a-39f1-4c67-b358-0551442df9c4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:26.676216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fa1f647a-39f1-4c67-b358-0551442df9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:26.680935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:26.681761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.682202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.682659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.683538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] RBAC: Adding query filter params (role.id=a15dae68603144eeb11a7d73681855f1, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=bcdb2a128abf4469b6ac5a7ac9459615) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:26.683983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:26.686074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da924c1-baac-4b1f-b5c6-09ef1089711f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:26.706524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 488/990] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:26 2022] GET /identity/v3/role_assignments?user.id=bcdb2a128abf4469b6ac5a7ac9459615&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=a15dae68603144eeb11a7d73681855f1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:26.759712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 503/991] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:26.773207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f957f-ff67-4e58-9807-71296e9cb13d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.773487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f957f-ff67-4e58-9807-71296e9cb13d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.773759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f957f-ff67-4e58-9807-71296e9cb13d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.775176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 489/992] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:26.780966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:26.781250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:26.781528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:26.803941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:26.805142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:26.837284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:26.878459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 504/993] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:27.026136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f957f-ff67-4e58-9807-71296e9cb13d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.127683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f957f-ff67-4e58-9807-71296e9cb13d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.143640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.162629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.163256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.163525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.163785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.164442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.165696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:27.174663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:27.175664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:27.176512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 490/994] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:27.181865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.198990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:27.252514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12ab8e-12d7-4f72-b70b-50c46961719a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.290835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.291377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.291505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d69-01bb-4c66-a67b-4445c9e7a50f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.291675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.291911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.292476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.294328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:27.302955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:27.303964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:27.304808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 505/995] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:27.309800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.339141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.339829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.340175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.340441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.340808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:27.341225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:27.341590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.343095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.347985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 491/996] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:27.356624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.413897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502495dd-bc89-442e-90fd-b263b507b168 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.443273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:27.450394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.451215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.451664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.451794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.452446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:27.452760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.454191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.464851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 506/997] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:27.465861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.472731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e56ba3-7425-43de-9dde-d44d93f5b52a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.509002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.509610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.509891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.510162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.510816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:27.511115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.512603 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.518725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 492/998] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:27.528046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.564168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:27.572163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50416eb0-a84c-4d52-a5df-09530b7cd936 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.608100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.608734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.609046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.609284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.609925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:27.610228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.611678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.618981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 507/999] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:27.624740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.642165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd13-5827-413d-be79-5ce277ef8e78 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.677627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.678220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.678516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.678789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.679465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.680811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.698083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 493/1000] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:01:27.736064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc446e-e583-4989-b354-f72e3abb7aa4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.780260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.780876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.781153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.781420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.782119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] RBAC: Adding query filter params (interface=public, service_id=ad2863292c2d4d5ab6790e9b5f1d6244, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:27.782422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.783835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d3876-6f3b-401c-ba9f-b6a2f5fc8d1e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.794292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 508/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/endpoints?service_id=ad2863292c2d4d5ab6790e9b5f1d6244&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:27.795474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:27.798508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:27.913338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4b79-af1c-4ca0-bf63-f3943793d9fc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:27.948616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:27.949211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:27.949482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:27.949744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:27.950337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:27.951721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abda947-04c0-4d0a-881a-dbc83ccddc0a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:27.958021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 494/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:27 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:01:28.917222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b365b-46f2-46f4-851e-be0d80dc2da3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:28.917780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b365b-46f2-46f4-851e-be0d80dc2da3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:28.917780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b365b-46f2-46f4-851e-be0d80dc2da3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:28.919219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 509/1003] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:28.926083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:28.926532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:28.926713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:28.946610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:28.947781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:29.006884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:29.015869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 495/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:29.291865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b365b-46f2-46f4-851e-be0d80dc2da3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:29.314149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:29.402822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b365b-46f2-46f4-851e-be0d80dc2da3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:29.435908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:29.436467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:29.436742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:29.437009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:29.437576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:29.438963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:29.448101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:29.449109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:29.449949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:29.454100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 510/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Sep 19 16:01:29 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:29.455455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:29.554387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc01080-980d-4546-b729-bdb40be25484 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:29.588596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:29.589203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:29.589475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:29.589741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:29.590361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] RBAC: Adding query filter params (name=image) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:29.590685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:29.592381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfb7f0-89e0-4120-b3b9-6c9383d24341 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:29.601998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 496/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:29.603158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:29.687960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:29.705572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcac89f-9c9b-4b15-b1b4-f98e7926b520 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:29.739805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:29.740407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:29.740681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:29.740949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:29.741568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] RBAC: Adding query filter params (type=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:29.741867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:29.743257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31be08-f122-4f23-8e20-820c01c86783 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:29.754576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 511/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:29.946713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6811cd-436c-4127-87b3-cc8b833b989a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:29.947205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6811cd-436c-4127-87b3-cc8b833b989a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:29.947205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6811cd-436c-4127-87b3-cc8b833b989a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:29.948650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 497/1008] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:29.953877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869f0d-223f-4633-83fa-7d4147952b66 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:29.954272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869f0d-223f-4633-83fa-7d4147952b66 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:29.954434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869f0d-223f-4633-83fa-7d4147952b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:29.972547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ac869f0d-223f-4633-83fa-7d4147952b66 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:29.974365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ac869f0d-223f-4633-83fa-7d4147952b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:30.046911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 512/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:30.131430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5829c3-c60d-48e7-84d4-5b2943e08b9a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.131807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5829c3-c60d-48e7-84d4-5b2943e08b9a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.132009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5829c3-c60d-48e7-84d4-5b2943e08b9a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.133442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 498/1010] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:30.138329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.138651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.138926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.157184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:30.158353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:30.226959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 513/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:30.316290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5829c3-c60d-48e7-84d4-5b2943e08b9a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:30.385206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:30.429019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5829c3-c60d-48e7-84d4-5b2943e08b9a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:30.463983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:30.464605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.464875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.465136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.466236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:30.467680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:30.469403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 499/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:30.475091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:30.486323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:30.496637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:30.578954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98318f-0e55-4f74-8b2d-62450d2e5342 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:30.610410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac4b9-8edb-4507-8d3a-95bc84d2296f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:30.616091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:30.616779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.617054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.617322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.617991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:30.619484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:30.646432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:30.662523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 514/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:30 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:01:30.662751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:30.662751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.662751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.662751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.663072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:30.663072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:30.667781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:30.668839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:30.669674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 500/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:30.675162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:30.743681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:30.790821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a0d5-10aa-483b-80c6-61b5abb4ba23 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:30.830700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:30.831319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.831595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.831866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.832492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:30.833319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:30.834727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:30.840472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 515/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:30.846254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:30.948516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858955c8-9cde-4143-9a3a-85601a56a0f6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:30.983341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:30.983945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:30.984218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:30.984485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:30.985101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:30.985398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:30.986773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386a51-77ec-4f53-b514-f306665ddba7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:30.991996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 501/1016] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Sep 19 16:01:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:30.997560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:31.099299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566f194-cf22-43d9-b576-25c77b717461 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:31.121916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:31.133210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:31.133811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:31.134084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:31.134351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:31.135046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:31.136393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2370f-f8c4-4791-af7d-db26266a2802 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:31.162510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 516/1017] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:31.888420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79120-fcaf-4a10-b554-85b857f60213 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:31.888697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79120-fcaf-4a10-b554-85b857f60213 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:31.888993 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79120-fcaf-4a10-b554-85b857f60213 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:31.890470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 502/1018] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:31.895517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cc20-d009-4b7c-9c5e-410b0e103828 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:31.895807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cc20-d009-4b7c-9c5e-410b0e103828 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:31.896077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116cc20-d009-4b7c-9c5e-410b0e103828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:31.913936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6116cc20-d009-4b7c-9c5e-410b0e103828 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:31.915129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6116cc20-d009-4b7c-9c5e-410b0e103828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:31.990377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 517/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:31 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:32.253470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79120-fcaf-4a10-b554-85b857f60213 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:32.315980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:32.369454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79120-fcaf-4a10-b554-85b857f60213 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:32.404557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:32.405167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:32.405442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:32.405710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:32.406358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:32.407748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de56f-ba9c-4445-b0a7-6fc829e1e761 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:32.426528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 503/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:32 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:32.854616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542874b-7941-46a4-8699-3337379c13b8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:32.855174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542874b-7941-46a4-8699-3337379c13b8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:32.855174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542874b-7941-46a4-8699-3337379c13b8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:32.856623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 518/1021] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:32.861677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:32.861963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:32.862236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:32.880963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:32.882141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:32.961269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 504/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:33.236273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542874b-7941-46a4-8699-3337379c13b8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:33.348248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542874b-7941-46a4-8699-3337379c13b8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:33.357770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:33.388001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:33.388627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:33.388905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:33.389174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:33.390282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:33.391762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623eba5-b358-45bd-982b-1658e18c62d1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:33.393473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 519/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:33.399105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:33.439825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693bf7-c1ac-4b11-b3e9-ed28968d9092 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:33.440149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693bf7-c1ac-4b11-b3e9-ed28968d9092 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:33.440447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693bf7-c1ac-4b11-b3e9-ed28968d9092 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:33.441836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 520/1024] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:33.442938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:33.447323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:33.447607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:33.447884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:33.466408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:33.467662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:33.502856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5bb2-21fa-42d7-9575-fbdaea69b846 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:33.537068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 521/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:33.537543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:33.538220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:33.538511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:33.538788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:33.539438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:33.540858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:33.570515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 505/1026] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:01:33 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:33.808974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:33.908119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5dc62-1ed1-4582-8a45-221d926af149 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:33.910537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:33.943928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:33.944560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:33.944838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:33.945109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:33.955193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:33.960538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:33.961431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:33.962279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:33.963593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 522/1027] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:33.967976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.066007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:34.071677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee96c-faac-45b9-a3dc-ee88c2ac56d2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.107695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.108303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.108579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.108850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.109505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:34.109830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:34.111201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:34.119548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 506/1028] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:34.125856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.226212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de0b6c-7796-4096-929b-d9e7f345bb2d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.260375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.261004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.261283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.261559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.272260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:34.273703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:34.288901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:34.289853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:34.291117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:34.291117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:34.291117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:34.294560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 523/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:34.296034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.411268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cae7b6-2167-49be-bc34-1073d362b207 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.445043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.445638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.445907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.446169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.446828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:34.447122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:34.448464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853282-6356-413e-b1b4-2939a25d8fff None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:34.460778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:34.466276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.487177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:34.573546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395cb1e-794f-48a5-817d-d1842bff7ac2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.593847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b66cc-151b-46fb-9785-cb518a4cff0a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.594126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b66cc-151b-46fb-9785-cb518a4cff0a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.594401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b66cc-151b-46fb-9785-cb518a4cff0a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.595855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 508/1031] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:34.600766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.601184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.601461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.614607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.615168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.615438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.615701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.620027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:34.621209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:34.623348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:34.624764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:34.636280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:34.636712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:34.637662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:34.638871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 524/1032] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:34.643893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.698867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 509/1033] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:34.726909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:34.750461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9ae89-1364-4525-b8bf-9fcbfc45179a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.784160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.784763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.785028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.785298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.786033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:34.786327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:34.787754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:34.806259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 525/1034] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:34.811759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:34.914268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d351f-bcc7-407e-ab91-cf6c976dfec8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:34.949137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:34.949738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:34.950009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:34.950273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:34.968218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:34.969793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.023558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.025114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.070821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0428-d8be-43ac-903d-c63262cee748 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.107677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.108909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.109637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.110097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.111059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.113365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.116433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:35.125056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:35.126116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:35.126989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 526/1035] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:35.132250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.142544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 510/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:35.143566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.204142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.237053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22324a-8b42-4b3d-9a3c-7150e839d334 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.258956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e560-ee4b-40b8-a1c7-519650981b58 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.275535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.276395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.276844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.277117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.277742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] RBAC: Adding query filter params (name=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:35.278045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.279461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.284261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 527/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:35.290515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.296461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.297082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.297352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.297617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.308658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.310063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:35.326345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:35.327389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:35.331648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:35.331648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:35.331648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:35.331648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 511/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:35.333941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.365123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.407646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7af5-f165-4dd3-b19f-99310f381516 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.443646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.444365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.444639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.444914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.445534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:35.445833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.447474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.449820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9fa82-4fcf-4999-a16a-bb3e3919c7be None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.451377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.453945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 528/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:35.460561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.492570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.493477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.493965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.494214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.494876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:35.495174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.497421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.510967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 512/1040] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:35.516390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.570026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecfd9-b985-4516-9f4a-1e5f901541b9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.597768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.608374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.608974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.609247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.609515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.610202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] RBAC: Adding query filter params (interface=public, service_id=0f2b762ca12a48b5819b963b5fb1afbd, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:35.610523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.611874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.617141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 529/1041] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/endpoints?service_id=0f2b762ca12a48b5819b963b5fb1afbd&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:35.622451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.624204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405c1ca-5eb9-421c-ba51-81f9b6507673 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.664080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.664722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.664996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.665251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.672836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.674306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:35.687001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:35.688235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:35.689696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 513/1042] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:35.695468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.722376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.741764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0111a-18ca-4bad-a51f-49fc75160417 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.778893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.779502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.779783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.780056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.780661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.782020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf2c0b-1b55-4d70-bf52-37050ba0bee4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.789297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 530/1043] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:01:35.797822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a01-6efb-445f-af4f-8aa7738cb724 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.798147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a01-6efb-445f-af4f-8aa7738cb724 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.798370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a01-6efb-445f-af4f-8aa7738cb724 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.799791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 531/1044] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:01:35.806622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.806944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.807168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.811613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a720-b294-4a78-bcf5-74a8a9253c28 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:35.833524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:35.834783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:35.854648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:35.855281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:35.855553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:35.855823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:35.856526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:35.856826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:35.858391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:35.878234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 514/1045] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:35.880788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:35.897271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.918385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 532/1046] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:35.978315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:35.997761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5406c2-f561-4cca-9424-acbe16b6e9e0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:36.033084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:36.033681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:36.033948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:36.034208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:36.034941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] RBAC: Adding query filter params (role.id=a15dae68603144eeb11a7d73681855f1, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:36.035245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:36.036691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:36.046555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 515/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:35 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=a15dae68603144eeb11a7d73681855f1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:36.193074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:36.297281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f70b-f63a-4392-a807-6795a674b0e4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:36.336319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:36.337472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:36.337946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:36.338412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:36.349773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:36.354999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:36.355974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:36.356851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:36.358737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 533/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:36.364971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:36.466952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e4440-4a50-4f6d-bd33-dfe66abdc58a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:36.501494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:36.502100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:36.502373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:36.502668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:36.503316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:36.503611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:36.504997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:36.518712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 516/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:36.520490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:36.568303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:36.626066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc39d4c-f5fd-4f30-b8ab-9a28c1355049 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:36.659544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:36.660168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:36.660442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:36.661247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] PATH_INFO: `/v3/users/eeb0eef2137e44c98f8366035853fa75` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:36.675550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] RBAC: Authorizing `identity:get_user(user_id=eeb0eef2137e44c98f8366035853fa75)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:36.677960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:36.680999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 534/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:36 2022] GET /identity/v3/users/eeb0eef2137e44c98f8366035853fa75 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:36.685937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:36.697757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:36.788298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcca55-71bb-4baf-9d33-dd888709cf45 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:36.823611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:36.824126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:36.824392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:36.824652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:36.893337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:36.894827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:36.906929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:37.000965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 517/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:37.002103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:37.100986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe5f-3a97-4449-8398-642fae5b72bf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:37.102400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:37.135469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:37.136085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:37.136356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:37.136619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:37.137704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:37.139148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b22e1-4979-4ec4-9d5a-8d4bb3af1530 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:37.140918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 535/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:37 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:37.147439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:37.244773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f40a-eb47-4179-b305-25dd46940813 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:37.254062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:37.280802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:37.281396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:37.281662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:37.281923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:37.282665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80, user.id=eeb0eef2137e44c98f8366035853fa75) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:37.282961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:37.284359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffbda9-9892-4b25-8a74-9a1c97fca44f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:37.298753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 518/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:37 2022] GET /identity/v3/role_assignments?user.id=eeb0eef2137e44c98f8366035853fa75&scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:37.983350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e775-136d-45ce-9184-bda5c6e89e1b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:37.983880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e775-136d-45ce-9184-bda5c6e89e1b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:37.983880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e775-136d-45ce-9184-bda5c6e89e1b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:37.985366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 536/1054] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:37.991162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2d0-8eec-4613-b9bd-a4a9dba24c3d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:37.991554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2d0-8eec-4613-b9bd-a4a9dba24c3d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:37.991716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2d0-8eec-4613-b9bd-a4a9dba24c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.009631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7fa9e2d0-8eec-4613-b9bd-a4a9dba24c3d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:38.010839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7fa9e2d0-8eec-4613-b9bd-a4a9dba24c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:38.082466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 519/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:38.171830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c9f4-1132-4c98-bdc9-70edf1dfc4c9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.172152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c9f4-1132-4c98-bdc9-70edf1dfc4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.172380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c9f4-1132-4c98-bdc9-70edf1dfc4c9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.173837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 537/1056] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:38.179506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.179789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.180060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.197969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:38.199154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:38.264655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 520/1057] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:38.353689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7c9f4-1132-4c98-bdc9-70edf1dfc4c9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.458390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7c9f4-1132-4c98-bdc9-70edf1dfc4c9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.492733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53869fd-e105-451a-806f-334556cf050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:38.493371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53869fd-e105-451a-806f-334556cf050f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.493641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53869fd-e105-451a-806f-334556cf050f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.493909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53869fd-e105-451a-806f-334556cf050f None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.494504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53869fd-e105-451a-806f-334556cf050f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:38.495896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53869fd-e105-451a-806f-334556cf050f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c53869fd-e105-451a-806f-334556cf050f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:38.504872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:38.505859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:38.511493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 538/1058] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:38.512311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.530285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53869fd-e105-451a-806f-334556cf050f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.548631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:38.566157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:38.626874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3ed5-9010-4427-babc-9c5009a0d337 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.633870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53869fd-e105-451a-806f-334556cf050f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.667036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:38.667965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.668098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:38.668307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.668506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.668669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.668946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.669122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] RBAC: Adding query filter params (name=image) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:38.669300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.669453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:38.670782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:38.675945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 521/1059] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:38.682276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:38.686076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:38.686711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:38.687623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:38.688470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:38.689105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 539/1060] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:38.694083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.792289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:38.800872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665c43-24a9-4fc4-bdb3-f2bc6b622a93 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.803069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:38.809923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334ba5c-43ac-4709-bfd3-2fa6c013b355 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.841248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:38.841939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.842280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.842584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.843274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:38.843535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:38.844894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:38.846604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:38.847267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:38.847542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:38.847810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:38.848475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] RBAC: Adding query filter params (type=image) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:38.848771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:38.850118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:38.853596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 540/1061] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:38.858743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.859769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 522/1062] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:38.865302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:38.970061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f673-02ac-4155-bb20-2544100fd3ac None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:38.973279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e187bf1-2f02-4488-92b4-56a61b6cbf72 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.019022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.019751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.019958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.020845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.020952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.021533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.021803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.022064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.022751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.024108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.033192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.034733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.052100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 523/1063] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:01:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:39.061343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:39.062404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:39.063662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:39.063662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:39.063662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:39.063662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 541/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:39.069334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.089930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.188281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0ee4b-bdd9-4c9e-956b-97cd5e9da6e9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.226986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.227590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.227864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.228130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.228765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:39.229060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.230419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.243119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 524/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:39.248804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.260686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.362663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a48eb-4735-4c7a-840c-2da1a5a542b8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.397615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.398245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.398649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.398830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.406743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.408177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-bc48af45-be3b-41f5-a1e7-5dddea201084 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:39.420180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:39.421117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:39.422622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 542/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:39.427232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.428072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16abc68-aff9-4a1f-8ccc-3f2c7eba071d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.428351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16abc68-aff9-4a1f-8ccc-3f2c7eba071d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.428625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16abc68-aff9-4a1f-8ccc-3f2c7eba071d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.430023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 543/1067] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:39.434869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.435374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.435565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.454307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:39.455533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:39.502752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.521988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.538510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 544/1068] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:39.538722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2c93f-8f7f-424a-ae46-6de04c3b1d54 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.574708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.575306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.575574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.575836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.576548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:39.576956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.578362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.595524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 525/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:39.601976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.700789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58879b2-6de7-41f1-a03e-8a5144173b45 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.734121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.734766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.735038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.735300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.745642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.747112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:39.761346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:39.762299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:39.763230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:39.763230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:39.763230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:39.763230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 545/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:39.768221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.809294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.865175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.877981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27ebaf-3912-41d8-881f-811bf3e17444 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.909190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:39.916333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.917047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.917396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.917673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.918407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:39.918872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:39.920174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:39.920690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d802-7f82-4ea1-ae34-705e9f251245 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:39.936571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 526/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:39.937548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:39.960048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:39.960610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:39.960886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:39.961153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:39.972672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:39.978189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:39.979199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:39.980073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 546/1072] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:39.985143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.049318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010b4e-8c2c-41dc-8fcd-cf508f70836a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.087094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.087718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.087990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.088258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.094947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.095228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8b49-9d9c-46f1-af55-9bdd0392503d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.096383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.106597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:40.108821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:40.110194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:40.111163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 527/1073] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:40.116340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.138719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.139318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.139593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.139861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.140511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:40.140807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.142164 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.154527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 547/1074] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:40.157140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.174097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:40.228955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75a34-1745-4a4f-8d05-e5bf00f48c29 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.259849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b02-20ce-428c-ac3d-fed4d67ac1ed None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.271362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.272114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.272383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.272648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.273322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:40.273618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.275135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.292865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 528/1075] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:40.293827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.300301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.300929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.301233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.301502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] PATH_INFO: `/v3/users/eeb0eef2137e44c98f8366035853fa75` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.302924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] RBAC: Authorizing `identity:get_user(user_id=eeb0eef2137e44c98f8366035853fa75)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.304387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.306529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 548/1076] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:40 2022] GET /identity/v3/users/eeb0eef2137e44c98f8366035853fa75 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:40.311942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.360808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:40.411695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795efb7-6edf-48d3-bd86-a7cf3a284a6c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.422739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:40.423524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e445a6-28d5-4db2-8293-3eeb1dd7a421 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.450601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.451257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.451535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.451807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/a15dae68603144eeb11a7d73681855f1` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.454386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=6fe2a726da0f429ba1de83b2ff0ea950, role_id=a15dae68603144eeb11a7d73681855f1)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.455842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495403d-afa0-4b02-8548-bc14cae6e2f1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.461219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.461858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.462155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.462385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.463649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.465080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.471520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 549/1077] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:40 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:40.472468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:40.474896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 529/1078] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:40 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/6fe2a726da0f429ba1de83b2ff0ea950/roles/a15dae68603144eeb11a7d73681855f1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:01:40.576350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ae52-0f2b-49d2-b33d-12f471b1f85d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:40.586219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:40.612527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:40.613191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:40.613461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:40.614289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80/users/eeb0eef2137e44c98f8366035853fa75/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:40.616243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f6f4674dc264bdc9a3fd25a9a485d80, user_id=eeb0eef2137e44c98f8366035853fa75, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:40.617681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273b3f7-8ff6-45d9-bea4-c87dee526835 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:40.632622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 550/1079] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:40 2022] PUT /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80/users/eeb0eef2137e44c98f8366035853fa75/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:01:41.247506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228889f-3645-4122-95a8-5b0e72f0ef28 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:41.248142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228889f-3645-4122-95a8-5b0e72f0ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:41.248142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228889f-3645-4122-95a8-5b0e72f0ef28 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:41.249384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 530/1080] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:41.254693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:41.255108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:41.255278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:41.273008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:41.274182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:41.344599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 551/1081] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:41.612114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228889f-3645-4122-95a8-5b0e72f0ef28 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:41.716580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228889f-3645-4122-95a8-5b0e72f0ef28 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:41.751024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:41.751619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:41.751889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:41.752152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:41.790595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:41.821095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:41.822547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:41.922070 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 531/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:41.928526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:42.025770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:42.031069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90337e5-5457-48f6-a2fa-b9e3b3211634 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:42.067003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:42.067626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.067900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.068165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.078064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:42.079528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-71d62f96-5a01-45b0-8aa3-c547a5a14552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:42.094454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:42.095513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:42.096533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:42.096533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:42.096533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:42.097283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 552/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:42.102364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:42.172010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:42.204462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953a1e-aa4b-4c82-bd3f-ce8424125882 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:42.239506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:42.240102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.240372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.240642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.241367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:42.241658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:42.243117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff8687-3fbf-426f-95bc-52eef5a3cd2b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:42.258707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 532/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:42.669090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8639-9c30-4b0e-b62f-f1fbff7d79e6 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.669674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8639-9c30-4b0e-b62f-f1fbff7d79e6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.669674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8639-9c30-4b0e-b62f-f1fbff7d79e6 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.671055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 553/1085] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:42.677725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd25a-3637-4823-9105-e1e42a5104e3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.678012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd25a-3637-4823-9105-e1e42a5104e3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.678289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd25a-3637-4823-9105-e1e42a5104e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.697884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-70fbd25a-3637-4823-9105-e1e42a5104e3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:42.699111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-70fbd25a-3637-4823-9105-e1e42a5104e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:42.764885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 533/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:42.782569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5ea26-e029-4836-ba87-a05606a87274 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.782847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5ea26-e029-4836-ba87-a05606a87274 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.783117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5ea26-e029-4836-ba87-a05606a87274 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.784424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 554/1087] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:42.789596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:42.789878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:42.790153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:42.808632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:42.809796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:42.862981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:42.874911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 534/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:43.036361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5ea26-e029-4836-ba87-a05606a87274 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.135783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5ea26-e029-4836-ba87-a05606a87274 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.148038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.169241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.169861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.170136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.170398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.184205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:43.189001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:43.190101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:43.190985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 555/1089] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:43.196586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.208750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.251145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f831-b487-4183-9530-dc0868fa9df6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.284735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.285378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.286245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.286589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.295585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fa87-7b22-43e6-add0-2ba67c8ca322 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.297114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:01:43.302735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:43.303699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:43.304621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 535/1090] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:43.309974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.329860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.330527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.330808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.331077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.331723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:43.332018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.333401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.343336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 556/1091] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:43.350021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.368264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.419027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e158b6-7f3d-4ad9-b076-721d9abbc80c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.421454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.452845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626360-2ba1-4a95-8060-1390a32e0375 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.453451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.454053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.454333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.454793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.455452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:43.455752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.457101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.465154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 536/1092] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:43.470950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.491978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.492591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.492862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.493127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.503376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.504810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:43.518372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:43.519348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:43.520396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:43.520396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:43.520396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:43.520396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 557/1093] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:43.525179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.573859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd070b-b03f-4e5e-a9c9-a1e92aa85792 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.586970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.608254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.608865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.609154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.609404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] PATH_INFO: `/v3/users/eeb0eef2137e44c98f8366035853fa75` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.610516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] RBAC: Authorizing `identity:get_user(user_id=eeb0eef2137e44c98f8366035853fa75)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.611927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.613666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 537/1094] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/users/eeb0eef2137e44c98f8366035853fa75 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:43.619124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.626369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3155b-2c70-4dbb-a019-549d5e8ef315 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.649823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.661372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.662251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.662557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.662830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.663459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:43.663760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.665104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.679182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 558/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:43.685225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.729977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d172f7-e31d-4aca-83b1-05f9886a2136 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.762815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.763416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.763694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.763961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.782368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b81c04-9811-4572-9abb-4eea2f071bdf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.811746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.816585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.817421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.817697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.817964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.824946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.826311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.830823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.832825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:01:43.838158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:43.839160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:01:43.840092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 559/1096] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:43.844879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.888653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:43.935724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 538/1097] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:01:43.941446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:43.943003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f14f87-7704-4a6b-9ba8-95b2b157a620 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:43.976436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:43.977031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:43.977306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:43.977576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:43.978288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:43.978624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:43.980043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.001654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 560/1098] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:44.002758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.027027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.047207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fe611-a052-4618-bd03-b2bd4023f8cb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.081369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab414866-a569-4051-b9df-247dca070738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.081901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab414866-a569-4051-b9df-247dca070738 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.082168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab414866-a569-4051-b9df-247dca070738 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.083010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab414866-a569-4051-b9df-247dca070738 None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.084263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab414866-a569-4051-b9df-247dca070738 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.086048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab414866-a569-4051-b9df-247dca070738 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.087689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 539/1099] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:43 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:44.093556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab414866-a569-4051-b9df-247dca070738 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.102646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ad79-c446-49c3-9b77-d1a206b76b9a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.104322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.138035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.138666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.138942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.139209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.191288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab414866-a569-4051-b9df-247dca070738 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.207042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.209039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.226545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.227137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.227406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.227671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.228377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80, user.id=eeb0eef2137e44c98f8366035853fa75) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:44.228675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.230067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.235814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 540/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/role_assignments?user.id=eeb0eef2137e44c98f8366035853fa75&scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:01:44.311746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 561/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:44.318182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.334912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.435096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38cd3-0aa1-443a-9466-162ed5051c80 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.470067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.470718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.470988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.471252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.481648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.483104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:01:44.497313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:44.498440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:01:44.499610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:01:44.499610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:01:44.499610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:44.499610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 541/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:01:44.506139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.508318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.606277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7cec-ab37-42b3-9ff4-fd0173608b4f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.639858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.640448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.640718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.640981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.641604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:44.641896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.643274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.654415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 562/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:44.659812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.722350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.760907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b2e-5a17-4854-b54e-bb2ee4902929 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.799271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.799894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.800165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.800432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.807880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.809305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:01:44.820374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:01:44.821328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:01:44.822213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 542/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:01:44.827269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:44.888785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:44.928683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df0aa-39c0-413b-802d-b3d649271b06 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:44.962647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:44.963240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:44.963512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:44.963778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:44.964448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:44.964751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:44.966191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca4800-17b5-42b6-8834-eb65df20cca2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:44.984158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 563/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:44.985470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:45.083984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a978-f3ad-4455-8453-557a3d262fc0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:45.106751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:45.117697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:45.118294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:45.118605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:45.118876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:45.119585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] RBAC: Adding query filter params (role.id=a15dae68603144eeb11a7d73681855f1, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=6fe2a726da0f429ba1de83b2ff0ea950) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:45.119886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:45.121296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90a32-cab3-4fda-8cf0-6c8b8e52b8d9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:45.127040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 543/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:44 2022] GET /identity/v3/role_assignments?user.id=6fe2a726da0f429ba1de83b2ff0ea950&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=a15dae68603144eeb11a7d73681855f1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:46.404341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb95-6086-4d35-8acb-2decdc1da52e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:46.404816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb95-6086-4d35-8acb-2decdc1da52e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:46.404931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb95-6086-4d35-8acb-2decdc1da52e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:46.406185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 564/1107] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:46.411826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:46.412223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:46.412360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:46.431033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:46.432202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:46.496633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 544/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:01:46.761472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4bb95-6086-4d35-8acb-2decdc1da52e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:46.859867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4bb95-6086-4d35-8acb-2decdc1da52e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:46.881175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:46.892481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:46.893265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:46.893541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:46.893804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:46.895446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:46.896853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0d56d-f6d9-4884-9099-87d467c241c0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:46.898370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 565/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:46.904045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:46.999510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325fe5-d3d0-4756-bf18-58d3f34eba87 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:47.025315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:47.042253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:47.042904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:47.043174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:47.043442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:47.044075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:47.045485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b2878-3cca-461d-9703-e24b6956b363 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:47.065668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 545/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:01:46 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:01:49.244705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1e53-17e8-4e0c-b904-c87a8179132e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:49.245659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1e53-17e8-4e0c-b904-c87a8179132e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:49.246175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1e53-17e8-4e0c-b904-c87a8179132e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:49.247544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 566/1111] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:49.252746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:49.253146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:49.253291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:49.271568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:49.272750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:49.340941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 546/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:49.605835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1e53-17e8-4e0c-b904-c87a8179132e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:49.701304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1e53-17e8-4e0c-b904-c87a8179132e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:49.734028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:49.734655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:49.734927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:49.735193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] PATH_INFO: `/v3/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:49.736538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] RBAC: Authorizing `identity:get_role(role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:49.737883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:49.739201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 567/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:49 2022] GET /identity/v3/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:49.744820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:49.848366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209d4a0-5a0c-4574-a1bb-a055348b4660 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:49.850646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:49.882134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:49.882731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:49.883005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:49.883269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] PATH_INFO: `/v3/users/74085949759f41a08d06fe87b71935f4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:49.896308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] RBAC: Authorizing `identity:get_user(user_id=74085949759f41a08d06fe87b71935f4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:49.897729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:49.899337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 547/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:49 2022] GET /identity/v3/users/74085949759f41a08d06fe87b71935f4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:49.905159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:49.961685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:50.000436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744f67-efa9-401f-b7ea-42da7acb6a91 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:50.038462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:50.039090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:50.039368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:50.039636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:50.104401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:50.105835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:50.160152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:50.201139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 568/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:50.207631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:50.304940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf43a8-1eaa-4e71-8156-9069b8bd20e1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:50.338008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:50.338652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:50.338928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:50.339201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:50.340294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:50.341709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7e00f-b69f-4237-b312-ed3d03d42324 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:50.343345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 548/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:50 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:50.349419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:50.447728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730fa5-cdef-436e-83b7-624a7cacfb28 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:50.480082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:50.480673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:50.480949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:50.481220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:50.481930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80, user.id=74085949759f41a08d06fe87b71935f4) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:50.482240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:50.483691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8c39-4326-4a00-8a73-7b9d2e43edf5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:50.489389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 569/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:50 2022] GET /identity/v3/role_assignments?user.id=74085949759f41a08d06fe87b71935f4&scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:52.587717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958de42f-31d4-46fa-8775-3d85002f3d4d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:52.588313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958de42f-31d4-46fa-8775-3d85002f3d4d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:52.588313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958de42f-31d4-46fa-8775-3d85002f3d4d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:52.589568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 549/1118] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:52.594705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:52.595105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:52.595253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:52.616268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:52.617394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:52.636093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:52.692026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 570/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:52.962752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958de42f-31d4-46fa-8775-3d85002f3d4d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:52.992016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:53.061577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958de42f-31d4-46fa-8775-3d85002f3d4d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:53.094706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:53.095316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:53.095586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:53.095851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] PATH_INFO: `/v3/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:53.097203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] RBAC: Authorizing `identity:get_role(role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:53.098580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:53.099965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 550/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:52 2022] GET /identity/v3/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:53.105795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:53.201246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481409-5dc6-4f75-b2c7-4b56c6f1a1c6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:53.233725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:53.234265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:53.234560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:53.234829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] PATH_INFO: `/v3/users/74085949759f41a08d06fe87b71935f4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:53.235941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] RBAC: Authorizing `identity:get_user(user_id=74085949759f41a08d06fe87b71935f4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:53.237333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:53.238909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 571/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:53 2022] GET /identity/v3/users/74085949759f41a08d06fe87b71935f4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:53.244684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:53.338237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:53.342642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f137-f2b2-428f-b333-7336108fd0d3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:53.377527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:53.378140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:53.378412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:53.378710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:53.380429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:53.381840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe7fc3-1610-46b4-ad15-7aaa318996aa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:53.383479 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 551/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:53 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:53.389370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:53.410438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:53.486803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd65b-1ddf-4e7a-a858-e8f9a8637cfa None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:53.519831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:53.520466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:53.520740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:53.521008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80/users/74085949759f41a08d06fe87b71935f4/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:53.523112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] RBAC: Authorizing `identity:create_grant(project_id=5f6f4674dc264bdc9a3fd25a9a485d80, user_id=74085949759f41a08d06fe87b71935f4, role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:53.524532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c22da-deab-4bbd-a836-20499c6896ef None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:53.536358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 572/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:01:53 2022] PUT /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80/users/74085949759f41a08d06fe87b71935f4/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:01:55.625024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247ca2-bdf8-4e59-89b4-482c4ef73faa None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:55.625516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247ca2-bdf8-4e59-89b4-482c4ef73faa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:55.625516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247ca2-bdf8-4e59-89b4-482c4ef73faa None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:55.626828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 552/1124] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:55.632905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:55.633323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:55.633449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:55.651691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:55.652858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:55.716965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 573/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:55.990521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c247ca2-bdf8-4e59-89b4-482c4ef73faa None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:56.088494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c247ca2-bdf8-4e59-89b4-482c4ef73faa None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:56.120607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:56.121218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:56.121492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:56.121763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] PATH_INFO: `/v3/roles/c671f50b95e84a49999b4f8970f53bc4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:56.123147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] RBAC: Authorizing `identity:get_role(role_id=c671f50b95e84a49999b4f8970f53bc4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:56.124507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:56.125798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 553/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:55 2022] GET /identity/v3/roles/c671f50b95e84a49999b4f8970f53bc4 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:56.131978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:56.143191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:56.228803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1108-88ac-444b-bb1e-19e38177f3fd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:56.261418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:56.261975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:56.262251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:56.262543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] PATH_INFO: `/v3/users/74085949759f41a08d06fe87b71935f4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:56.263641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] RBAC: Authorizing `identity:get_user(user_id=74085949759f41a08d06fe87b71935f4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:56.265070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:56.266637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 574/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:01:56 2022] GET /identity/v3/users/74085949759f41a08d06fe87b71935f4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:56.272877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:56.306580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:56.371917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19deb8-823e-49f5-a6b3-0515d4843aa1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:56.404403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:56.404984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:56.405251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:56.405512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:56.469143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:56.470570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:56.501296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:56.566120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 554/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:01:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:01:56.572488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:56.647926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:56.668994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed8eea-5de3-4da2-9ce8-34e125ec2733 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:56.703441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:56.704056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:56.704332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:56.704604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] PATH_INFO: `/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:56.705709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6f4674dc264bdc9a3fd25a9a485d80)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:56.707212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afd6c9-e42c-4735-878c-ac22c1252507 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:56.708814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 575/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:01:56 2022] GET /identity/v3/projects/5f6f4674dc264bdc9a3fd25a9a485d80 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:56.715074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:56.813959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6693d-2d09-40b5-ad27-ed4023564b41 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:56.847901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:56.848445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:56.848719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:56.848985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:56.849697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] RBAC: Adding query filter params (role.id=c671f50b95e84a49999b4f8970f53bc4, scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80, user.id=74085949759f41a08d06fe87b71935f4) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:01:56.849995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:56.851531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c951e51-80ea-4cc3-ad67-116ae8e6a193 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:56.853232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:56.858128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 555/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:01:56 2022] GET /identity/v3/role_assignments?user.id=74085949759f41a08d06fe87b71935f4&scope.project.id=5f6f4674dc264bdc9a3fd25a9a485d80&role.id=c671f50b95e84a49999b4f8970f53bc4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:58.977241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1adde-8ec2-46f9-89d5-5ba8ade32787 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:58.977796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1adde-8ec2-46f9-89d5-5ba8ade32787 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:58.977796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1adde-8ec2-46f9-89d5-5ba8ade32787 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:58.979141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 576/1131] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:01:58.984336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:58.984744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:58.984955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:59.002544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:01:59.004211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:01:59.068550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 556/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:01:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:01:59.340865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1adde-8ec2-46f9-89d5-5ba8ade32787 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:59.438874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1adde-8ec2-46f9-89d5-5ba8ade32787 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:59.471904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:59.472547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:59.472816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:59.473081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:59.474159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:59.475614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e67287-d547-453c-95ce-ae2240757790 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:59.477140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 577/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:01:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:01:59.483107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:01:59.579202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461050c7-18dd-4d4d-98f4-aa952d1512ed None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:01:59.604175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:01:59.612107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:01:59.612698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:01:59.613507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:01:59.613778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:01:59.614409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:01:59.615855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c491f-2682-4f3f-9551-924b4ccd8d28 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:01:59.641613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 557/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:01:59 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:02:01.828041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469cae-e32c-49d8-80fd-01c99925e8f7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:01.828558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469cae-e32c-49d8-80fd-01c99925e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:01.828558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469cae-e32c-49d8-80fd-01c99925e8f7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:01.829882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 578/1135] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:01.835183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:01.835597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:01.835732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:01.853586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:01.854789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:01.923110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 558/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:02.192698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9469cae-e32c-49d8-80fd-01c99925e8f7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:02.207873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:02.290924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9469cae-e32c-49d8-80fd-01c99925e8f7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:02.323406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:02.324014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:02.324283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:02.324547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:02.325616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:02.327067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae92d-174c-4003-8255-41ef309dc674 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:02.328602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 579/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:02:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:02.334861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:02.433896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384807-1c70-4185-8d35-7b564eac3da7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:02.444453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:02.468684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:02.469283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:02.469559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:02.469829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:02.470507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:02.471927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5fd5c-cb58-4f45-b999-24d815e3327b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:02.492659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 559/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:02:02 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:02:04.648690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de083b-190d-41fc-bb51-82b3fa830768 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:04.649206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de083b-190d-41fc-bb51-82b3fa830768 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:04.649206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de083b-190d-41fc-bb51-82b3fa830768 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:04.650445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 580/1139] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:04.655582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:04.655993 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:04.656132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:04.674465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:04.675690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:04.740559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 560/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:05.008206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de083b-190d-41fc-bb51-82b3fa830768 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.088554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:05.107427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de083b-190d-41fc-bb51-82b3fa830768 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:05.139901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:05.140502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:05.140776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:05.141041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:05.151402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:05.156096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:05.157236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:05.158348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 581/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:05.163218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.252630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:05.259704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756c93-3f92-4e26-a3d8-66b2ac359106 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:05.292186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:05.292776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:05.293047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:05.293312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:05.293953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:05.294245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:05.295623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:05.304154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 561/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:05.310108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.406501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30704b37-7119-4644-9e62-6041c2b8e571 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:05.439492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:05.440106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:05.440381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:05.440647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] PATH_INFO: `/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:05.451804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:05.454344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0d5170a50e410f9865cc1be7b6a9c6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:05.456219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:05.458006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 582/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:05.463660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.560185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc72ff-f4c5-4353-afe3-b7f4b8301102 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:05.592399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:05.592981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:05.593255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:05.593524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:05.619632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:05.659264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:05.661224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:05.755745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 562/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:05.761553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.857550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b8fa-671d-49b2-a4d4-6f8a403e7764 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:05.889847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:05.890458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:05.890757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:05.891026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] PATH_INFO: `/v3/projects/3040016429804e05a1c59d31b3e083bf` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:05.892110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] RBAC: Authorizing `identity:get_project(project_id=3040016429804e05a1c59d31b3e083bf)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:05.893524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0a87f-6aa2-4410-9003-fb34503f06e6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:05.895778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 583/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/projects/3040016429804e05a1c59d31b3e083bf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:05.901867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:05.958836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:05.998316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6217-775f-48fa-b31b-d1b86005af76 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:06.030889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76839-633b-4354-baef-131064a43aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:06.031464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76839-633b-4354-baef-131064a43aab None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:06.031734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76839-633b-4354-baef-131064a43aab None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:06.031998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76839-633b-4354-baef-131064a43aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:06.032696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76839-633b-4354-baef-131064a43aab None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=3040016429804e05a1c59d31b3e083bf, user.id=9e0d5170a50e410f9865cc1be7b6a9c6) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:06.032997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76839-633b-4354-baef-131064a43aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:06.034394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76839-633b-4354-baef-131064a43aab None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:06.041113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 563/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:02:05 2022] GET /identity/v3/role_assignments?user.id=9e0d5170a50e410f9865cc1be7b6a9c6&scope.project.id=3040016429804e05a1c59d31b3e083bf&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:08.122566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bb1c-0883-4dc9-a067-f13243fd22b3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:08.123127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bb1c-0883-4dc9-a067-f13243fd22b3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:08.123127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0bb1c-0883-4dc9-a067-f13243fd22b3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:08.124427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 584/1147] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:08.129451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:08.129819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:08.129988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:08.147592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:08.148752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:08.214580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 564/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:08.478878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0bb1c-0883-4dc9-a067-f13243fd22b3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:08.549635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:08.584605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0bb1c-0883-4dc9-a067-f13243fd22b3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:08.617302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:08.617913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:08.618184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:08.618453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:08.628218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:08.633438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:08.634580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:08.635569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 585/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:08.641061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:08.691720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:08.737110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f197fb-74c2-4da6-a941-0ba9c0113466 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:08.770281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:08.770904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:08.771178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:08.771446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:08.772093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:08.772391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:08.773748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:08.781552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 565/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:08.787944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:08.885581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc24a-eb7e-48e6-97b3-197d80fa50d0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:08.911208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:08.919398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:08.920019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:08.920293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:08.920562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] PATH_INFO: `/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:08.921657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0d5170a50e410f9865cc1be7b6a9c6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:08.923130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:08.924685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 586/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:08 2022] GET /identity/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:08.931365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:09.028092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea70f6-0f5d-420e-b699-f13f295d0471 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:09.041756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:09.062281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:09.062931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:09.063201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:09.063466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] PATH_INFO: `/v3/projects/3040016429804e05a1c59d31b3e083bf` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:09.064557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] RBAC: Authorizing `identity:get_project(project_id=3040016429804e05a1c59d31b3e083bf)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:09.065966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826285-47c3-46d1-81d7-703fe9057fef None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:09.067593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 566/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:08 2022] GET /identity/v3/projects/3040016429804e05a1c59d31b3e083bf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:09.073414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:09.168949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fc8b-2352-4a14-b567-41e6ea823c49 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:09.202075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:09.203113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:09.203591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:09.203917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] PATH_INFO: `/v3/projects/3040016429804e05a1c59d31b3e083bf/users/9e0d5170a50e410f9865cc1be7b6a9c6/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:09.205808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] RBAC: Authorizing `identity:create_grant(project_id=3040016429804e05a1c59d31b3e083bf, user_id=9e0d5170a50e410f9865cc1be7b6a9c6, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:09.207762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6390be3-48ea-471f-addf-f56e416bfc1a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:09.220572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 587/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:02:09 2022] PUT /identity/v3/projects/3040016429804e05a1c59d31b3e083bf/users/9e0d5170a50e410f9865cc1be7b6a9c6/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:02:11.312328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbcde-e06a-4fc2-8bae-ab2efdbdcca5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:11.312890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbcde-e06a-4fc2-8bae-ab2efdbdcca5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:11.312890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbcde-e06a-4fc2-8bae-ab2efdbdcca5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:11.314181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 567/1154] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:11.320058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:11.320440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:11.320605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:11.338684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:11.339862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:11.390217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:11.407514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 588/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:11.679079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fbcde-e06a-4fc2-8bae-ab2efdbdcca5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:11.776048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fbcde-e06a-4fc2-8bae-ab2efdbdcca5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:11.808647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:11.809301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:11.809573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:11.809838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:11.819907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:11.824592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:11.825739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:02:11.827062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 568/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:11.831645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:11.927068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cfc8b-f8ee-4ffb-a6e1-65d725be26eb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:11.959258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:11.959793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:11.960068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:11.960333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:11.960981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:11.961277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:11.962655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:11.970307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 589/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:11.976782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:12.019775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:12.076982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88611aad-9ad5-486c-8841-c201956bae2f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:12.110234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:12.110871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:12.111148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:12.111417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] PATH_INFO: `/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:12.112514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] RBAC: Authorizing `identity:get_user(user_id=9e0d5170a50e410f9865cc1be7b6a9c6)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:12.113958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:12.115549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 569/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:11 2022] GET /identity/v3/users/9e0d5170a50e410f9865cc1be7b6a9c6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:12.121323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:12.169211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:12.225089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbd168-95b5-4daf-9aed-a55fa539b772 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:12.256657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:12.257245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:12.257520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:12.257789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:12.321647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:12.323114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:12.368850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:12.418044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 590/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:02:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:12.423958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:12.523857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdad00-a302-4fc9-89b4-2a19b3a32b72 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:12.533710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:12.556748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:12.557356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:12.557626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:12.557888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] PATH_INFO: `/v3/projects/3040016429804e05a1c59d31b3e083bf` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:12.558988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] RBAC: Authorizing `identity:get_project(project_id=3040016429804e05a1c59d31b3e083bf)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:12.560392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a69e-26e8-4c66-abad-45215c498e6e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:12.561985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 570/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:12 2022] GET /identity/v3/projects/3040016429804e05a1c59d31b3e083bf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:12.568608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:12.663719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a81b8-d793-4202-8507-ff0d354b5971 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:12.696084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:12.696662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:12.696933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:12.697201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:12.697903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=3040016429804e05a1c59d31b3e083bf, user.id=9e0d5170a50e410f9865cc1be7b6a9c6) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:12.698204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:12.699650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28258f03-04ec-4cfa-82dc-04074e9e2971 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:12.705108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 591/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:02:12 2022] GET /identity/v3/role_assignments?user.id=9e0d5170a50e410f9865cc1be7b6a9c6&scope.project.id=3040016429804e05a1c59d31b3e083bf&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:14.880347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed46d-5911-486d-805d-a1e97f1c9c46 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:14.880895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed46d-5911-486d-805d-a1e97f1c9c46 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:14.880895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed46d-5911-486d-805d-a1e97f1c9c46 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:14.882209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 571/1162] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:14.887438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:14.887859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:14.887964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:14.906066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:14.907254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:14.914250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:14.974187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 592/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:02:15.244022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed46d-5911-486d-805d-a1e97f1c9c46 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:15.343770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed46d-5911-486d-805d-a1e97f1c9c46 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:15.376909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:15.377510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:15.377779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:15.378044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:15.422311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:15.444505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:15.445931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:15.541536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 572/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:02:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:15.547486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:15.642634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7231-aa5e-409d-a112-40a75c5da7d1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:15.675125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:15.675759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:15.676036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:15.676305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:15.682965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:15.684391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-9a5235ab-7a31-46f5-8494-c270051bca3c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:15.695929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:15.697151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:15.697997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 593/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:02:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:15.703255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:15.778976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:15.801062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759c44-c27e-4e26-a783-5ce816d3a8e6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:15.833641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:15.834220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:15.834500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:15.834784 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:15.835400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:15.835692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:15.837031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841a5e5-3c99-47f1-b373-0b42a8f8b821 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:15.843995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 573/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Sep 19 16:02:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:17.966078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fece85-d8f6-44b3-be73-9278f7ea6f27 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:17.966628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fece85-d8f6-44b3-be73-9278f7ea6f27 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:17.966628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fece85-d8f6-44b3-be73-9278f7ea6f27 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:17.967962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 594/1167] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:17.974191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1785-f8f7-44bb-bc53-333000895a92 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:17.974640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1785-f8f7-44bb-bc53-333000895a92 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:17.975038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1785-f8f7-44bb-bc53-333000895a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:17.993684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-eeec1785-f8f7-44bb-bc53-333000895a92 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:17.994879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eeec1785-f8f7-44bb-bc53-333000895a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:18.059278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 574/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:18.324214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fece85-d8f6-44b3-be73-9278f7ea6f27 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:18.327228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:18.423995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fece85-d8f6-44b3-be73-9278f7ea6f27 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:18.456329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:18.457471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:18.457739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:18.457998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:18.458661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:18.460013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45b9f9-50d2-4d34-bfb0-6d8e8111598d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:18.475334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 595/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Sep 19 16:02:18 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:02:20.618659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b020df-02de-4e8b-a882-4183dbf4f9d8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:20.619178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b020df-02de-4e8b-a882-4183dbf4f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:20.619178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b020df-02de-4e8b-a882-4183dbf4f9d8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:20.620429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 575/1170] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:20.625564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:20.626002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:20.626112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:20.644305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:20.645464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:20.699435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:20.709867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 596/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:02:20.976038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b020df-02de-4e8b-a882-4183dbf4f9d8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:21.046521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:21.076338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b020df-02de-4e8b-a882-4183dbf4f9d8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:21.109644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:21.110254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:21.110550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:21.110822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] PATH_INFO: `/v3/domains/ed5eaac0be3b4d4fb25c09077d4f491b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:21.120996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed5eaac0be3b4d4fb25c09077d4f491b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:21.122417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce100924-255f-4410-b418-62beb40a2b22 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:21.124001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 576/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Sep 19 16:02:20 2022] GET /identity/v3/domains/ed5eaac0be3b4d4fb25c09077d4f491b => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:21.129961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:21.224807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7b25a-0fd0-47de-bf38-6bdd7c8c0fe6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:21.257003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:21.257528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:21.257799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:21.258064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:21.258731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:21.260144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9341a-74b7-4e89-a092-6d6e7de08fec None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:21.285971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 597/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:02:21 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:02:23.425908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa625-491d-41f0-9a5e-1090be013d0b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:23.426694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa625-491d-41f0-9a5e-1090be013d0b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:23.426783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa625-491d-41f0-9a5e-1090be013d0b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:23.428059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 577/1174] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:23.433614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:23.434034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:23.434154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:23.451839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:23.452993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:23.491377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:23.517639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 598/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:23.787079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa625-491d-41f0-9a5e-1090be013d0b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:23.885364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa625-491d-41f0-9a5e-1090be013d0b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:23.917180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:23.922714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:23.923331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:23.923601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:23.923867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] PATH_INFO: `/v3/domains/ed5eaac0be3b4d4fb25c09077d4f491b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:23.924966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed5eaac0be3b4d4fb25c09077d4f491b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:23.926732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d5c7-dbdc-4f56-9a75-03fafdb59c83 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:23.928289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 578/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Sep 19 16:02:23 2022] GET /identity/v3/domains/ed5eaac0be3b4d4fb25c09077d4f491b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:23.934036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:24.030628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a042d2-3561-40b7-85f9-0c32eb97217f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:24.064193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:24.064718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:24.064997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:24.065268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:24.065921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:24.067992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8d462-197d-4ce9-b592-02f746447708 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:24.089033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 599/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:02:23 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:02:26.229502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5672cd-fe61-4db7-8150-9dc72192752f None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:26.230057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5672cd-fe61-4db7-8150-9dc72192752f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:26.230057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5672cd-fe61-4db7-8150-9dc72192752f None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:26.231413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 579/1178] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:26.236730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:26.237102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:26.237282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:26.255634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:26.256816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:26.279822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:26.322839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 600/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:26.592577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5672cd-fe61-4db7-8150-9dc72192752f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:26.692886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5672cd-fe61-4db7-8150-9dc72192752f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:26.725010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:26.725616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:26.725888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:26.726156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:26.736287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:26.741657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:26.742859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:02:26.743896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 580/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:26.748770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:26.843946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e230c4-52f2-40cb-97bb-db1fa69310f4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:26.875612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:26.876196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:26.876467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:26.876733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:26.877375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:26.877667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:26.879053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:26.887223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 601/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:26.893155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:26.951045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:26.992550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff71db-28de-4eff-8eaa-d8f3041de76f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:27.028403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:27.029028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:27.029348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:27.029630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] PATH_INFO: `/v3/users/e9557f1dde1745099a57f3469ef868e9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:27.042723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] RBAC: Authorizing `identity:get_user(user_id=e9557f1dde1745099a57f3469ef868e9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:27.044159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:27.045756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 581/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:26 2022] GET /identity/v3/users/e9557f1dde1745099a57f3469ef868e9 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:02:27.052518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:27.077137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.150523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7c3-1769-4378-b2b5-f00b4e44bc76 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:27.182808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:27.183403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:27.183677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:27.183945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:27.251096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:27.252537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:27.277480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.354863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 602/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:02:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:27.360816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:27.459488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a62f3-2134-4984-b0aa-2b15fbb1dbba None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:27.476561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.493535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:27.494151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:27.494424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:27.494728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] PATH_INFO: `/v3/projects/a6ca0ace9ec3416a959dba6b937aa291` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:27.495827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] RBAC: Authorizing `identity:get_project(project_id=a6ca0ace9ec3416a959dba6b937aa291)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:27.497242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016f867-c895-4b1c-bedf-9c225e503fee None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:27.498888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 582/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:27 2022] GET /identity/v3/projects/a6ca0ace9ec3416a959dba6b937aa291 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:27.505094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:27.599054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af9d4-c40a-4945-a732-77de39d62f01 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:27.624344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:27.634887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:27.635485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:27.635760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:27.636031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:27.636748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=a6ca0ace9ec3416a959dba6b937aa291, user.id=e9557f1dde1745099a57f3469ef868e9) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:27.637054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:27.638478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9f72-5310-4531-a04c-4eb46b69970d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:27.643737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 603/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:02:27 2022] GET /identity/v3/role_assignments?user.id=e9557f1dde1745099a57f3469ef868e9&scope.project.id=a6ca0ace9ec3416a959dba6b937aa291&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:29.768923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956edec6-d6bf-4024-b747-0f35cf2d90e2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:29.769442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956edec6-d6bf-4024-b747-0f35cf2d90e2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:29.769537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956edec6-d6bf-4024-b747-0f35cf2d90e2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:29.770952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 583/1186] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:29.776083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:29.776525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:29.776651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:29.795582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:29.796763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:29.861129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 604/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:30.149560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956edec6-d6bf-4024-b747-0f35cf2d90e2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:30.256196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956edec6-d6bf-4024-b747-0f35cf2d90e2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:30.291472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:30.292085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:30.292357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:30.292624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:30.303277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:30.308045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:30.309184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:02:30.310251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 584/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:30.315182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:30.411701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa451-da26-44da-8467-b908cca95766 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:30.428185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:30.445350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:30.445941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:30.446217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:30.446500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:30.447208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:30.447506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:30.448867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:30.456621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 605/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:30.462424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:30.508896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:30.561513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1f601-894f-466c-9a4d-9453b79a630c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:30.599766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:30.600507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:30.600785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:30.601054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] PATH_INFO: `/v3/users/e9557f1dde1745099a57f3469ef868e9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:30.602232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] RBAC: Authorizing `identity:get_user(user_id=e9557f1dde1745099a57f3469ef868e9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:30.603681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:30.605264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 585/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:30 2022] GET /identity/v3/users/e9557f1dde1745099a57f3469ef868e9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:30.612845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:30.713854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863b54b-616f-4627-b9fc-9c965eb5b0d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:30.746252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:30.746894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:30.747170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:30.747440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] PATH_INFO: `/v3/projects/a6ca0ace9ec3416a959dba6b937aa291` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:30.748532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] RBAC: Authorizing `identity:get_project(project_id=a6ca0ace9ec3416a959dba6b937aa291)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:30.749959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6f988-4eea-4676-b7a1-835d0f6cc924 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:30.751591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 606/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:30 2022] GET /identity/v3/projects/a6ca0ace9ec3416a959dba6b937aa291 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:30.758144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:30.856436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c008e-cde4-47c7-ad1a-386b6c87937e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:30.870440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:30.890592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:30.891226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:30.891494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:30.891757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] PATH_INFO: `/v3/projects/a6ca0ace9ec3416a959dba6b937aa291/users/e9557f1dde1745099a57f3469ef868e9/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:30.893596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6ca0ace9ec3416a959dba6b937aa291, user_id=e9557f1dde1745099a57f3469ef868e9, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:30.895050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a38b7a-7a32-416a-b690-2322958a2de3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:30.906992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 586/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:02:30 2022] PUT /identity/v3/projects/a6ca0ace9ec3416a959dba6b937aa291/users/e9557f1dde1745099a57f3469ef868e9/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:02:33.027415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bf00-e6ff-4b84-8b8c-174126cacb41 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.027971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bf00-e6ff-4b84-8b8c-174126cacb41 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.027971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4bf00-e6ff-4b84-8b8c-174126cacb41 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:33.029267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 607/1193] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:02:33.034600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0e643-cb54-4869-9664-a50817177abd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.035019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0e643-cb54-4869-9664-a50817177abd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.035127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0e643-cb54-4869-9664-a50817177abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:33.053678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1de0e643-cb54-4869-9664-a50817177abd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:02:33.054885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1de0e643-cb54-4869-9664-a50817177abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:02:33.119561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 587/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:02:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:02:33.396153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4bf00-e6ff-4b84-8b8c-174126cacb41 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:33.442827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:33.495557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4bf00-e6ff-4b84-8b8c-174126cacb41 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:33.527218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:33.527823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.528097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.528363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:33.538977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:02:33.543647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:02:33.544714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:02:33.545904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 608/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:02:33.550786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0e643-cb54-4869-9664-a50817177abd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:33.646136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0e643-cb54-4869-9664-a50817177abd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:33.648320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:33.679527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:33.680115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.680384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.680649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:33.681290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:33.681583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:33.682973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:33.690714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 588/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:33.697233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:33.794153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829583-def0-494e-8109-34e2a5fe6693 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:33.800809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:33.830077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:33.830729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.831010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.831283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] PATH_INFO: `/v3/users/e9557f1dde1745099a57f3469ef868e9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:33.832672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=e9557f1dde1745099a57f3469ef868e9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:33.834097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:33.835707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 609/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Sep 19 16:02:33 2022] GET /identity/v3/users/e9557f1dde1745099a57f3469ef868e9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:33.841493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:33.938644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c76df-b8da-4b88-965d-3290280e3fb3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:33.970971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:33.971556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:33.971825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:33.972089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:34.005115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:34.038428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:34.039895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:34.134376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 589/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:02:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:02:34.140435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:34.237640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dff4b-3da7-4eed-a441-ad6f5beef9f4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:34.269969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:34.270633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:34.270904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:34.271168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] PATH_INFO: `/v3/projects/a6ca0ace9ec3416a959dba6b937aa291` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:34.272252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] RBAC: Authorizing `identity:get_project(project_id=a6ca0ace9ec3416a959dba6b937aa291)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:34.273665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1f3a1-9702-4cca-9e72-8bb1db58b8eb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:34.275289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 610/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Sep 19 16:02:34 2022] GET /identity/v3/projects/a6ca0ace9ec3416a959dba6b937aa291 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:34.281522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:02:34.345228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:34.380428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361308-243a-4e0c-ad43-2a60b7b55d2a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:02:34.413424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:02:34.414012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:02:34.414285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:02:34.414579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:02:34.415284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=a6ca0ace9ec3416a959dba6b937aa291, user.id=e9557f1dde1745099a57f3469ef868e9) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:02:34.415585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:02:34.416992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f062-73c0-418e-b37a-62bdd06c6cca None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:02:34.422578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 590/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:02:34 2022] GET /identity/v3/role_assignments?user.id=e9557f1dde1745099a57f3469ef868e9&scope.project.id=a6ca0ace9ec3416a959dba6b937aa291&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:02:44.265859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=79 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:02:44.420007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=35 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:30.020663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0c56-f410-4fed-aa6d-678e64c29884 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:30.021309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0c56-f410-4fed-aa6d-678e64c29884 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:30.021309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0c56-f410-4fed-aa6d-678e64c29884 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:30.022766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 611/1201] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:30.033393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:30.034018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:30.034018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:30.060662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:30.061982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:30.167852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 591/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:30.484046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0c56-f410-4fed-aa6d-678e64c29884 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:30.609439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0c56-f410-4fed-aa6d-678e64c29884 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:30.651658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:30.652346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:30.652642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:30.652953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:30.664300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:30.665731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:30.682788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:30.683937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:30.687863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:30.687863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:30.687863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:30.687863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 612/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:30.691128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:30.820549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91227e-ca2e-4da4-a3fb-4cb7197d532c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:30.857069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:30.867521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:30.868138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:30.868413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:30.868730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:30.869405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:30.869810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:30.871658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0db5-6074-4dcf-a3de-5da04c0ef6fa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:30.886225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 592/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:03:30.892065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:30.968176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:31.032345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97287b2-8017-41c2-93a7-677055691fc5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:31.073007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:31.073606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:31.073877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:31.074145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:31.074831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:31.076253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c0b22-4014-463f-80fa-ad80048eaa5d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:31.102027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 613/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Sep 19 16:03:30 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:03:33.528080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcc59-dbf7-480d-b926-ef70d278179b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:33.528673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcc59-dbf7-480d-b926-ef70d278179b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:33.528673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcc59-dbf7-480d-b926-ef70d278179b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:33.530233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 593/1206] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:33.535833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:33.536266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:33.536443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:33.555791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:33.556979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:33.629099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 614/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:33.900095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcc59-dbf7-480d-b926-ef70d278179b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:34.027031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcc59-dbf7-480d-b926-ef70d278179b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:34.071460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:34.072076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:34.072472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:34.072755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:34.086009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:34.091716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:34.093192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:34.094128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 594/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:03:34.099738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:34.149694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:34.231831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc55fd-bdf2-4e7e-8474-f22bd0f82bdf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:34.274748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:34.275468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:34.275857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:34.276186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:34.277114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:34.277579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:34.279328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:34.290247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 615/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:34.296684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:34.368001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:34.432605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7e34-60f7-4c95-a4dc-a968c77a53d5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:34.475697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:34.478226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:34.478226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:34.478226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:34.489320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:34.490718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:34.506935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:34.507997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:34.508957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:34.508957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:34.508957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:34.513178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 595/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:34.514095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:34.632730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:34.637071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f0c1f-afd9-4360-a6a4-85ed82518302 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:34.681501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:34.682110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:34.682385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:34.682697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:34.683332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:34.683630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:34.684991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:34.702732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 616/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:34.708458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:34.825946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cc751-a5de-4f43-ae2c-60d4bb58da1d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:34.827645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:34.861956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:34.862815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:34.863998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:34.863998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:34.871529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:34.873058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:34.884768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:34.885966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:34.887573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 596/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:34.892630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:35.003429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceaa70-8c54-4f29-961e-2ea9d03d1552 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:35.045759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:35.046944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:35.047351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:35.047758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:35.049501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:35.050096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:35.052117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:35.081594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 617/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:35.083620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:35.225098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157186c0-d95e-43d6-88ee-52a8f031d24e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:35.261898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:35.262560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:35.262835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:35.263101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:35.297560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:35.344499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:35.345928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:35.464299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 597/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:03:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:03:35.470615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:35.496023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:35.607332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60a2c3-e019-4c80-bdf4-dfcb95dfced2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:35.650457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:35.651275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:35.651415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:35.651608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:35.662960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:35.664403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:35.682588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:35.683675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:35.684817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:35.684817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:35.684817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:35.684817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 618/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:35.691114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:35.758837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:35.803881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2f2c-52dd-4199-aed2-a7f199169bee None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:35.840949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:35.841553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:35.841830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:35.842109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:35.842776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:35.843079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:35.844444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:35.857537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 598/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:35.863775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:35.937353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:35.970861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab68d-a97a-4c62-b67d-c14400128a60 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:36.007572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:36.008311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:36.008622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:36.008895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:36.016680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:36.019003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:36.033466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:36.034857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:36.035768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 619/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:03:36.044090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:36.150898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92387-1fc6-4110-9dc3-321b07193239 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:36.178646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:36.191643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:36.192250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:36.192522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:36.192787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:36.193461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:36.193756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:36.195277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a01d-47d5-4228-acd7-1def5f460cdd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:36.210085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 599/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:36.216905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:36.330612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af19e-0535-465d-b18c-c1be970f27c0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:36.361242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:36.368626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:36.369257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:36.369542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:36.369822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:36.370797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=75492a4f8b854a78be8bcf582e4732d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:36.371199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:36.372653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aec91-6aeb-4fc6-87d2-19a2513e7c81 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:36.379051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 620/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:03:36 2022] GET /identity/v3/role_assignments?user.id=75492a4f8b854a78be8bcf582e4732d2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:38.621771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60056-15fd-4bda-950c-ca9166199a52 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:38.622302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60056-15fd-4bda-950c-ca9166199a52 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:38.622302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60056-15fd-4bda-950c-ca9166199a52 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:38.623922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 600/1220] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:38.629920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:38.630332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:38.630758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:38.651370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:38.652739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:38.726185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 621/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:39.016849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60056-15fd-4bda-950c-ca9166199a52 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.124009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60056-15fd-4bda-950c-ca9166199a52 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:39.161448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:39.162073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:39.162356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:39.162656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:39.174060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:39.180114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:39.181246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:39.182266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 601/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:03:39.187770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.292133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908e8f-4f4c-4146-92fd-f6173ab16c30 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:39.317248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:39.330238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:39.331185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:39.331498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:39.331741 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:39.332507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:39.332811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:39.334440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:39.343126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 622/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:39.350067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.398257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:39.463094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5b84-7457-4a85-ae9e-833c33471c0f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:39.502127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:39.504062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:39.504062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:39.504062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:39.514117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:39.515943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:39.537800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:39.543930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:39.545067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:39.545067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:39.545067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:39.545067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 602/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:39.545361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.652705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb1d24-d332-49bd-8c52-fb2afc15ca46 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:39.687477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:39.689531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:39.689531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:39.689531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:39.689878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:39.690099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:39.691831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:39.704071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 623/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:39.710378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.808212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:39.816238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978397b7-80c7-436b-a41f-94a917691999 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:39.854775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:39.855451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:39.855751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:39.856107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:39.865176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:39.866750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:39.879608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:39.880728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:39.881927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 603/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:39.886626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:39.940454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:39.998506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777e4a-c00c-48d1-8077-ab5f176667dc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.035765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.036421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.038475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.038788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.039576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:40.039929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.041586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.063147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 624/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:40.069767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:40.181454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006bce-8a86-4b40-8d66-9b885226436b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.216071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.216773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.217091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.217365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.229680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.231391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:40.248093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:40.249239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:40.250287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:40.250287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:40.250287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:40.250287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 604/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:40.255146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:40.363929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0423f-3872-4159-a2d3-fc42756b7282 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.366264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:40.402719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.403408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.403620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.404023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.404992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:40.405528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.406938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.422033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 625/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:40.429227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:40.438823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:40.546003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859b9e-9b6e-4a86-a71c-0c29b830211c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.581750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.582381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.582677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.582945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.590427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.591980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:40.604223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:40.610506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:40.611685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 605/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:40.612284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:40.716911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2408fd9-44e8-4cb2-a67a-6a68166e6a79 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.755400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.756129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.756407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.756679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.757375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:40.757675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.759126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133b1d9-b449-4105-bf43-edbb9123452e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.771606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 626/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:40.777441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:40.849754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:40.892690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000972-b7ea-4370-b4ea-ccee2d09102b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:40.932789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:40.933573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:40.933898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:40.934204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/75492a4f8b854a78be8bcf582e4732d2/roles/2b0caa89aaf34f099e4f7ee5b587dcce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:40.950264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=75492a4f8b854a78be8bcf582e4732d2, role_id=2b0caa89aaf34f099e4f7ee5b587dcce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:40.951750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccf733-4361-412d-b4d9-e7bea9e49d70 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:40.965010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 606/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:03:40 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/75492a4f8b854a78be8bcf582e4732d2/roles/2b0caa89aaf34f099e4f7ee5b587dcce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:03:43.158820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346d90-e174-4fbf-a1a6-6e7e93c765a1 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:43.159371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346d90-e174-4fbf-a1a6-6e7e93c765a1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:43.159371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346d90-e174-4fbf-a1a6-6e7e93c765a1 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:43.161043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 627/1233] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:43.166654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:43.167118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:43.167251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:43.188022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:43.189226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:43.263446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 607/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:43.551280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b346d90-e174-4fbf-a1a6-6e7e93c765a1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:43.576390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:43.658715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b346d90-e174-4fbf-a1a6-6e7e93c765a1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:43.697775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:43.698495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:43.698855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:43.699132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:43.711727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:43.716690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:43.717876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:43.718901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 628/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Sep 19 16:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:43.724721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:43.777778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:43.835128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e578d-f298-46c4-ab3c-2a85aec962e2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:43.882499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:43.883258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:43.883594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:43.883808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:43.884951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:43.885258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:43.886838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:43.896624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 608/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Sep 19 16:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:43.902501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:43.995323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:44.011008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55336e8a-1df5-4b08-acab-e4e0d94b5406 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:44.052984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:44.053624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:44.053896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:44.054160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:44.065116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:44.066780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:44.088578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:44.089841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:44.091106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:44.091106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:44.091106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:44.091106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 629/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:44.096186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:44.205771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7d88b-b601-411b-8b96-c16bb36d04a9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:44.215616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:44.243686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:44.244333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:44.244648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:44.244917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:44.245638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:44.245955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:44.247425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:44.260130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 609/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:44.266154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:44.380627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af062d8-4e0e-497e-af63-9f72e1e12c05 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:44.417845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:44.418474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:44.418782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:44.419053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:44.421869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:44.427836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:44.429724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:44.442507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:44.443717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:44.444863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 630/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:44.449602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:44.558474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e837-c923-4d45-b481-69fcfe4244af None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:44.595889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:44.596483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:44.596763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:44.597029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:44.597742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:44.598040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:44.599500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:44.617120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 610/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:44.623419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:44.734767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dec8ea-bbac-4e53-8a11-6a6ee68338f1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:44.772528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:44.773150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:44.773472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:44.773789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:44.843590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:44.853222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:44.854990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:44.975212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 631/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:03:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:03:44.983191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:45.012221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:45.097493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7843-ccaa-4c9f-b44d-a32a549897e2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:45.133943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:45.134599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:45.134873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:45.135138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:45.146037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:45.147452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:45.163527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:45.165169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:45.167134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:45.167134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:45.167134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:45.167134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 611/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:45.170442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:45.269809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:45.278463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7991c-5602-45e1-9a7b-5dbf66c5596e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:45.318337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:45.319262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:45.319679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:45.320053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:45.320817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:45.321252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:45.322904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:45.339019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 632/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:45.344410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:45.448386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:45.473841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd2c0-84ea-4532-8699-3c1a78c2ddf0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:45.511049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:45.511682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:45.511931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:45.512194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:45.519106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:45.520792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:45.533211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:45.534402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:45.538726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 612/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:45.540423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:45.652688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f573d2-f926-4b20-8e99-d825ee25db65 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:45.690804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:45.691578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:45.691897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:45.692301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:45.693063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:45.693470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:45.695029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690999-ff73-4dbb-97f5-f504b2b62549 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:45.707816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 633/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:45.714113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:45.832129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b97cc-1c04-4241-8499-0a38b2d26705 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:45.867096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:45.867696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:45.867966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:45.868228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:45.868935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] RBAC: Adding query filter params (role.id=2b0caa89aaf34f099e4f7ee5b587dcce, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=75492a4f8b854a78be8bcf582e4732d2) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:45.869236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:45.870684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf65a98-3c8e-4f7a-b2c2-5f6f6421bbf3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:45.876868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 613/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:03:45 2022] GET /identity/v3/role_assignments?user.id=75492a4f8b854a78be8bcf582e4732d2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2b0caa89aaf34f099e4f7ee5b587dcce => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:48.099297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c314c-27ec-4a79-865f-e55e5c99e1f0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:48.099969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c314c-27ec-4a79-865f-e55e5c99e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:48.099969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c314c-27ec-4a79-865f-e55e5c99e1f0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:48.101143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 634/1247] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:48.107012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:48.107462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:48.107748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:48.114936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:48.130714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:48.131914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:48.211012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 614/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:48.488086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c314c-27ec-4a79-865f-e55e5c99e1f0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:48.506660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:48.599013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c314c-27ec-4a79-865f-e55e5c99e1f0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:48.635654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:48.636290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:48.636581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:48.636836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:48.648518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:48.654815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:48.655787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:48.656622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 635/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:48.663308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:48.773972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909074-1618-4531-b9c7-b42380cc23a6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:48.804905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:48.811540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:48.812652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:48.813049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:48.813360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:48.814041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:48.814343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:48.816393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:48.826555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 615/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:48.834602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:48.923914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:48.948805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd1d0b-ccb4-43d6-ac98-e9c089f8aa7f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:48.983514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:48.984191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:48.984466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:48.984731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:48.997752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:48.999390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:49.015088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:49.016316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:49.017801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:49.017801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:49.017801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:49.017801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 636/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:49.022957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:49.139874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b0d23-79fa-4aaf-919d-63b9eed21d17 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:49.175505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:49.176025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:49.176295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:49.176559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:49.177202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:49.177502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:49.178918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:49.191923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 616/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:49.197747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:49.301626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183ce65-366b-4b81-b392-26714e035771 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:49.330868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:49.340679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:49.341315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:49.341590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:49.341890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:49.350373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:49.351885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:49.364642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:49.370570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:49.371781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 637/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:49.372386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:49.434538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:49.480611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f11208-30de-41d6-92f6-a548c353783a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:49.514310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:49.514937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:49.515210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:49.515473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:49.516188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:49.516991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:49.518397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:49.537408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 617/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:49.543192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:49.657009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584044d-24c9-4935-9e48-2430c24b5763 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:49.692550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:49.693069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:49.693335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:49.693596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:49.748448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:49.760927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:49.762376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:49.863773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 638/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:03:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:03:49.869518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:49.965642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631891eb-d344-460c-822b-12187ed1c51a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:49.978076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:49.998310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:49.998941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:49.999213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:49.999482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:50.009613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:50.011083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:50.025608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:50.026753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:50.027837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:50.027837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:50.027837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:50.027837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 618/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:50.032611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:50.126784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:50.138728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109643-8e90-4b11-b1d8-26ef0d4ff2b6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:50.172096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:50.172706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:50.172981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:50.173249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:50.173874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:50.174169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:50.175809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:50.186462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 639/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:50.193417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:50.295403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd24a7c-64a6-4574-8316-89bf57d10f6a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:50.328516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:50.329162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:50.329434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:50.329701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:50.336551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:50.337964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:50.348915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:50.349982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:50.351077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 619/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:50.355795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:50.452539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601e6f-1f8f-4cf3-8f45-1325f7a6395b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:50.484254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:50.484920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:50.485902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:50.486171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:50.486873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:50.487178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:50.488584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2890-d643-4922-aaa1-e4401e7a88bb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:50.502067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 640/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:50.508292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:50.544859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:50.622829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9789e2-e927-44de-bc15-a905caeb8696 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:50.655342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:50.655928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:50.656205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:50.656477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:50.657705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=75492a4f8b854a78be8bcf582e4732d2) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:50.658009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:50.659453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43411f-6dd5-4e7f-9108-f2e02a7008c9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:50.664661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 620/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:03:50 2022] GET /identity/v3/role_assignments?user.id=75492a4f8b854a78be8bcf582e4732d2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:52.793890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd22d1-3e18-456d-b4cc-5fdfa94a0dc3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:52.794421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd22d1-3e18-456d-b4cc-5fdfa94a0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:52.794421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd22d1-3e18-456d-b4cc-5fdfa94a0dc3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:52.795767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 641/1261] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:52.801640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:52.802054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:52.802182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:52.820709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:52.821882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:52.887222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 621/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:53.157618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd22d1-3e18-456d-b4cc-5fdfa94a0dc3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:53.168202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:53.254697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd22d1-3e18-456d-b4cc-5fdfa94a0dc3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:53.287105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:53.287708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:53.287979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:53.288244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:53.297811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:53.302811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:53.303900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:53.304750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 642/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:53.309739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:53.330020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:53.409332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10a463-4131-4719-a532-df4cc238a51b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:53.442872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:53.443465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:53.443735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:53.444002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:53.444647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:53.444942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:53.446329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:53.454372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 622/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:53.460103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:53.523978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:53.556153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484257d-cc07-44ad-a18c-190a44773b0b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:53.588789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:53.589386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:53.589656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:53.589921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:53.599517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:53.600930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:53.615220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:53.616323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:53.617429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:53.617429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:53.617429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:53.617429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 643/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:53.623544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:53.702563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:53.721609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec29d-8762-4148-8abe-a9881ed18dc0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:53.754678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:53.755272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:53.755543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:53.755809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:53.756429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:53.756723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:53.758060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:53.769500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 623/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:03:53.775093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:53.871125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67041-9ac4-4be1-8ff0-421b7d9ea61e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:53.889871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:53.904080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:53.904692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:53.904968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:53.905235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:53.914149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:53.915610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:53.927223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:53.928292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:53.929230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 644/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:53.934066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.031734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7543-25f8-4112-9ae2-61a6ebd5b005 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.069567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.070185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.070455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.070748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.071452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:54.071745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.073139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.082153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:54.090772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 624/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:54.097242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.192572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630b77-9bc0-4379-827f-28d608609f2c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.225299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.225897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.226171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.226437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.236654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.238083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:54.251691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:54.252793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:54.253912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:54.253912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:54.253912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:54.253912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 645/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:54.259925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.356413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753704d9-96b5-4695-a80b-4403e56bd4fb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.389530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.390171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.390454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.390753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.391965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:54.392270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.393644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.404576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 625/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:54.410138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.440981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:54.507127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae79b7-50b6-4cfc-9487-0adb3d2721a3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.539717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29632-be02-4664-8802-dd4231560490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.540323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29632-be02-4664-8802-dd4231560490 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.540594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29632-be02-4664-8802-dd4231560490 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.540859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29632-be02-4664-8802-dd4231560490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.547133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29632-be02-4664-8802-dd4231560490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.549459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29632-be02-4664-8802-dd4231560490 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-83e29632-be02-4664-8802-dd4231560490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:54.561915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:54.562916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:54.564606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 646/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:54.569290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.626564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:54.668089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b63b-913b-4fba-a42a-43a913464e97 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.700688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.701270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.701543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.701809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.702476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:54.702806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.704949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6fb5-2ff0-4bde-ae88-2155975ff207 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.716481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 626/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:54.722329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29632-be02-4664-8802-dd4231560490 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:54.810239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:54.819023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29632-be02-4664-8802-dd4231560490 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:54.851815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:54.852446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:54.852721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:54.852993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] PATH_INFO: `/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/75492a4f8b854a78be8bcf582e4732d2/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:54.854864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] RBAC: Authorizing `identity:create_grant(project_id=9302a86cb1744a22897c0864f7cfed4e, user_id=75492a4f8b854a78be8bcf582e4732d2, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:54.856287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1035-0e79-48aa-a8fa-c6d7358953ae None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:54.868504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 647/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Sep 19 16:03:54 2022] PUT /identity/v3/projects/9302a86cb1744a22897c0864f7cfed4e/users/75492a4f8b854a78be8bcf582e4732d2/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:03:57.095690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb9e5-e648-429e-9560-98b8d7bc3bfc None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:57.096246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb9e5-e648-429e-9560-98b8d7bc3bfc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:57.096246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb9e5-e648-429e-9560-98b8d7bc3bfc None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:57.097535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 627/1274] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:03:57.102763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:57.103138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:57.103303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:57.120908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:03:57.122063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:03:57.185804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 648/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:03:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:03:57.452015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb9e5-e648-429e-9560-98b8d7bc3bfc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:57.550719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb9e5-e648-429e-9560-98b8d7bc3bfc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:57.568059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:57.585404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:57.586019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:57.586293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:57.586591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:57.596463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:03:57.601249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:57.602346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:57.603598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 628/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Sep 19 16:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:57.608393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:57.686859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:57.706724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40b63a-9fe7-4e1a-aee4-58174e26ab82 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:57.739581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:57.740163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:57.740436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:57.740700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:57.741341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:57.741634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:57.743037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:57.751279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 649/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Sep 19 16:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:57.756967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:57.854115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86151573-7b79-49a5-ab80-724a93d9ce56 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:57.887540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:57.888082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:57.888352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:57.888616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:57.898250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:57.899689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:57.913791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:57.915007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:57.916107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:57.916107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:57.916107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:57.916107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 629/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:57.920557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.017216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72c39-13eb-465a-ba4d-6d5465f6abda None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.053145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.053765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.054096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.054385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.055105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:58.055412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.056923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:58.071246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 650/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:58.076924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.111938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:58.183581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9c7c3-cd5d-427d-ac75-2c003e4173dc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.215976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.216587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.216861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.217127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.224857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.226278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:03:58.237920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:58.239067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:03:58.240254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 630/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:03:58.244852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.248613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:58.340267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aba05-37d1-42b1-ac6f-4e84e9ea58c9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.373417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.374005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.374276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.374590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.375306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:58.375624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.377029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:58.393284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 651/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Sep 19 16:03:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:58.398997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.487950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:58.497732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5b4e-e707-45e9-8a0f-2c9e5e03eb74 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.530229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.530844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.531115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.531380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.597282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.598733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:58.688382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:58.698517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 631/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Sep 19 16:03:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:03:58.704736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.762892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:58.801618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3150af3-ff97-4440-9e72-a175df4c72b3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.834247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.834904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.835183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.835451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.845644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.847119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:03:58.861257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:58.862181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:03:58.863172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:03:58.863172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:03:58.863172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:58.863172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 652/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:58.867941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:58.963576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aa258-8a7b-4216-9e9a-f51114108094 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:58.995574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:58.996155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:58.996428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:58.996697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:58.997315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:58.997611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:58.998995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:59.010341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 632/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Sep 19 16:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:59.015947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:59.112810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ddda-d543-4e81-8443-b923d43b0c22 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:59.127130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:59.147609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:59.148224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:59.148498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:59.148761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:59.155142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:59.156574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:03:59.168176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:03:59.169217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Sep 19 16:03:59.170356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 653/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Sep 19 16:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:03:59.175500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:59.224520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:03:59.279059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddf40c-d476-40f3-a4ec-266ef48a8be4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:59.312686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:59.313835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:59.314109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:59.314378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:59.315087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:59.315386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:59.316800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45d079-aff1-468e-b1ad-b0a13ea59cc6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:59.328546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 633/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Sep 19 16:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:03:59.334773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:03:59.431532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7e56-68a1-4c07-9c94-f8127451608b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:03:59.463907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:03:59.464491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:03:59.464767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:03:59.465037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:03:59.465747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] RBAC: Adding query filter params (role.id=2838a4268e68454e8e20940d4f2b5800, scope.project.id=9302a86cb1744a22897c0864f7cfed4e, user.id=75492a4f8b854a78be8bcf582e4732d2) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:03:59.466052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:03:59.467491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183085a8-ee13-4cb7-ae53-acadf4b8de69 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:03:59.473074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 654/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Sep 19 16:03:59 2022] GET /identity/v3/role_assignments?user.id=75492a4f8b854a78be8bcf582e4732d2&scope.project.id=9302a86cb1744a22897c0864f7cfed4e&role.id=2838a4268e68454e8e20940d4f2b5800 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:01.645628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b3d7-c3bb-49ef-8069-26b2e60c8776 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:01.646126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b3d7-c3bb-49ef-8069-26b2e60c8776 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:01.646126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1b3d7-c3bb-49ef-8069-26b2e60c8776 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:01.647442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 634/1288] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:04:01.652662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:01.653075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:01.653198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:01.670812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:04:01.671988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:04:01.701161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:01.737359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 655/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:04:02.003516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1b3d7-c3bb-49ef-8069-26b2e60c8776 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:02.108185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1b3d7-c3bb-49ef-8069-26b2e60c8776 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:02.119242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:02.141948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:02.142601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:02.142879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:02.143156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:02.143728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:02.145086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:04:02.153787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:04:02.155035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:02.156081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 635/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:04:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:04:02.161742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:02.256917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebf75-a801-4bac-ba64-fee0b255b333 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:02.290501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:02.291116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:02.291393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:02.291663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:02.292279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:04:02.292577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:02.293938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fdd1-b73a-4d30-b742-b93472338e84 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:02.298641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 656/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Sep 19 16:04:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:02.304546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:02.403185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4a29-e1b0-4446-84a9-0995147037c5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:02.435992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:02.436580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:02.436856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:02.437127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:02.437769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:04:02.438068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:02.439449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bbc9-b098-423a-8eb6-0ecada6818f7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:02.443723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 636/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Sep 19 16:04:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:04.543224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b91a9-943d-4104-95ef-e264855e59b8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:04.543742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b91a9-943d-4104-95ef-e264855e59b8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:04.543742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b91a9-943d-4104-95ef-e264855e59b8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:04.545069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 657/1293] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:04:04.550436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b067-1fcb-4374-b5c9-6574ffe5996d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:04.550862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b067-1fcb-4374-b5c9-6574ffe5996d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:04.551011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b067-1fcb-4374-b5c9-6574ffe5996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:04.568812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f0a4b067-1fcb-4374-b5c9-6574ffe5996d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:04:04.569988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f0a4b067-1fcb-4374-b5c9-6574ffe5996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:04:04.600644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:04.636927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 637/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:04:04.901481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b91a9-943d-4104-95ef-e264855e59b8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:04.931332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:05.000631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b91a9-943d-4104-95ef-e264855e59b8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:05.033975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:05.034709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:05.034989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:05.035262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:05.035925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:05.037288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da7c45-3285-47fe-a571-b037934abd4b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:05.051267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 658/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Sep 19 16:04:04 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:04:07.175889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07acef1-594c-4546-b3ee-6c675e425f53 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:07.176449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07acef1-594c-4546-b3ee-6c675e425f53 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:07.176449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07acef1-594c-4546-b3ee-6c675e425f53 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:07.177750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 638/1296] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:04:07.182956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:07.183388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:07.183505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:07.201650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:04:07.202933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:04:07.272858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 659/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:04:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:04:07.534717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07acef1-594c-4546-b3ee-6c675e425f53 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:07.632030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07acef1-594c-4546-b3ee-6c675e425f53 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:07.668549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:07.669169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:07.669441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:07.669704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:07.670268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:07.671663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:04:07.680888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:04:07.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:07.683252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 639/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:04:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:04:07.688550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:07.706062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:07.783766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6b23-9ed3-4ac7-b1ad-56452e13e41b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:07.817730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:07.818256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:07.818570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:07.818841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:07.819460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:04:07.819757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:07.821112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:07.826163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 660/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Sep 19 16:04:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:07.832260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:07.863861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:07.930048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7344fc2-6fca-45f5-be09-ad521c65e338 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:07.964212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:07.964803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:07.965076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:07.965344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:07.966023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] RBAC: Adding query filter params (interface=public, service_id=483940c96d99438da9a1c8034f6181a7, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:04:07.966320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:07.967703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c8837-6863-45fc-9f9c-e2b6763ebd53 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:07.973137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 640/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Sep 19 16:04:07 2022] GET /identity/v3/endpoints?service_id=483940c96d99438da9a1c8034f6181a7&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:07.978742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:08.062513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:08.084865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f38b-e3e9-4718-a0bd-911d4a327441 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:08.122228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:08.122849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:08.123126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:08.123394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:08.123983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:08.125335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d2c21-52e6-4997-b170-33ae5ddba7f2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:08.131993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 661/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Sep 19 16:04:07 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:04:10.250414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60a1e-fb79-4135-8bed-2ccfbbd93570 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:10.250999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60a1e-fb79-4135-8bed-2ccfbbd93570 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:10.250999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60a1e-fb79-4135-8bed-2ccfbbd93570 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:10.252910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 641/1302] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:04:10.258114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:10.258498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:10.258689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:10.276866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:04:10.278060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:04:10.342079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 662/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:04:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:04:10.609743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d60a1e-fb79-4135-8bed-2ccfbbd93570 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:10.702106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:10.709251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d60a1e-fb79-4135-8bed-2ccfbbd93570 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:10.741687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:10.742295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:10.742596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:10.742865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:10.743427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:10.744771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:04:10.753824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:04:10.754891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Sep 19 16:04:10.755892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 642/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Sep 19 16:04:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:04:10.760943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:10.833483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:10.855766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92428-1db5-4a14-b340-e44e64f1483d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:10.887963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:10.888490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:10.888760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:10.889025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:10.889631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:04:10.889924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:10.891301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d4a77-aea0-4629-a3d0-69b5fcd1083b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:10.896243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 663/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Sep 19 16:04:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:04:10.901861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:04:10.999288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd6c-4dbb-438a-8324-c06c7a24a9ea None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:04:11.031626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:04:11.032201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:04:11.033012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:04:11.033280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:04:11.033932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:04:11.035306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c49d-cdfb-47f5-9faa-e688bd713c05 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:04:11.054556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 643/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:04:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:04:20.893310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=30 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:04:21.050373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:14.826375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434a3b-b73f-4a6c-9d53-21175cae9870 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:14.826881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434a3b-b73f-4a6c-9d53-21175cae9870 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:14.827627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434a3b-b73f-4a6c-9d53-21175cae9870 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:14.836264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5930c2b-800d-4c93-8ad1-1ae3a2d2389e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:14.836694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5930c2b-800d-4c93-8ad1-1ae3a2d2389e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:14.837287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5930c2b-800d-4c93-8ad1-1ae3a2d2389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:14.840132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 664/1307] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:15.035653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d5930c2b-800d-4c93-8ad1-1ae3a2d2389e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:15.037120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d5930c2b-800d-4c93-8ad1-1ae3a2d2389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:15.154788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 644/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:15.447981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:15.448286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:15.448678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:15.450347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 665/1309] 10.222.0.27 () {54 vars in 963 bytes} [Mon Sep 19 16:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:15.457279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd03a0-087c-46e9-a8d1-822a2b5ceaaa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:15.457580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd03a0-087c-46e9-a8d1-822a2b5ceaaa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:15.457855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd03a0-087c-46e9-a8d1-822a2b5ceaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:15.553538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f1dd03a0-087c-46e9-a8d1-822a2b5ceaaa None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:15.554788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f1dd03a0-087c-46e9-a8d1-822a2b5ceaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:15.578468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:15.640461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 645/1310] 10.222.0.27 () {58 vars in 1060 bytes} [Mon Sep 19 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:15.649718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:15.651655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:15.765043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145592-6944-4412-a9aa-bd97f4d2288a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:15.843875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:15.844512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:15.844858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:15.845137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:15.846780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:15.907974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:15.978466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:15.979926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39583d12-d619-4a60-baec-d86ad4eba651 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:16.000391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 666/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:18.511999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409619-b333-4271-a497-b104646de640 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:18.512548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409619-b333-4271-a497-b104646de640 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:18.512548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed409619-b333-4271-a497-b104646de640 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:18.513896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 646/1312] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:18.519511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6bbc-a557-44ef-8380-2eb9d4e2797a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:18.519959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6bbc-a557-44ef-8380-2eb9d4e2797a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:18.520054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6bbc-a557-44ef-8380-2eb9d4e2797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:18.592685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-51fd6bbc-a557-44ef-8380-2eb9d4e2797a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:18.593890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-51fd6bbc-a557-44ef-8380-2eb9d4e2797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:18.692047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 667/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:18.973888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed409619-b333-4271-a497-b104646de640 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:18.975614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ed409619-b333-4271-a497-b104646de640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:19.093323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed409619-b333-4271-a497-b104646de640 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:19.172618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:19.175753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:19.176549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:19.176988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:19.177435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:19.179117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:19.291987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:19.293476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf62b8-e3a1-4a0d-8717-d3f62d6e4aa9 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:19.311590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 647/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:21.772747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:21.773283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:21.773283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:21.774659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 668/1315] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:21.780527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b82cb-92ba-48ce-a297-2b726ea50f3a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:21.780950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b82cb-92ba-48ce-a297-2b726ea50f3a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:21.781069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b82cb-92ba-48ce-a297-2b726ea50f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:21.846428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9b5b82cb-92ba-48ce-a297-2b726ea50f3a None None] MFA Rules not processed for user `2752d28631c647fcb7a8953e5c6ff7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:21.847649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9b5b82cb-92ba-48ce-a297-2b726ea50f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:21.898133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:21.942271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 648/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:22.227699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:22.229233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:22.238932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:22.330715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8ba7-0011-430d-9ebb-c0a067fd9dbb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:22.403115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:22.403729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:22.404593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:22.404860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:22.406427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:22.468368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:22.513940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:22.515388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34609-75d4-472a-a9db-2712bb21156b service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:22.533224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 669/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:25.263575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:25.264148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:25.264148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:25.265437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 649/1318] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:25.270574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b485-07bd-4473-9678-73692ad13372 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:25.270945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b485-07bd-4473-9678-73692ad13372 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:25.271150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028b485-07bd-4473-9678-73692ad13372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:25.335724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c028b485-07bd-4473-9678-73692ad13372 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:25.336914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c028b485-07bd-4473-9678-73692ad13372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:25.433344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 670/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:25.716769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:25.718334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:25.821524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea4f0-4cfb-4d06-a83d-be018ba36bb6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:25.894288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:25.894907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:25.895183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:25.895454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:25.897068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:25.904708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:26.005764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:26.007172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48198-3541-4d6b-bf86-536e8d30b11d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:26.025685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 650/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:28.800323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db18b-9973-433d-b1ff-772d04deb74b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:28.800856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db18b-9973-433d-b1ff-772d04deb74b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:28.800856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db18b-9973-433d-b1ff-772d04deb74b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:28.802179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 671/1321] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:28.807305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b9da-c9de-4700-9aff-23ee1ddf262a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:28.807706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b9da-c9de-4700-9aff-23ee1ddf262a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:28.807971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0b9da-c9de-4700-9aff-23ee1ddf262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:28.877264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5bc0b9da-c9de-4700-9aff-23ee1ddf262a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:28.878569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5bc0b9da-c9de-4700-9aff-23ee1ddf262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:28.941452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:28.983873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 651/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:29.289072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e615-e124-4645-9f56-b65879d01069 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:29.289450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e615-e124-4645-9f56-b65879d01069 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:29.289816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e615-e124-4645-9f56-b65879d01069 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:29.291261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 672/1323] 10.222.0.27 () {54 vars in 963 bytes} [Mon Sep 19 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:29.297436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91139-c2a2-4afb-828a-2681fc694b7a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:29.297721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91139-c2a2-4afb-828a-2681fc694b7a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:29.298257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91139-c2a2-4afb-828a-2681fc694b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:29.380126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-add91139-c2a2-4afb-828a-2681fc694b7a None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:29.381330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-add91139-c2a2-4afb-828a-2681fc694b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:29.457097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 652/1324] 10.222.0.27 () {58 vars in 1060 bytes} [Mon Sep 19 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:29.466207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069e615-e124-4645-9f56-b65879d01069 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:29.467770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2069e615-e124-4645-9f56-b65879d01069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:29.487427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:29.574097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069e615-e124-4645-9f56-b65879d01069 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:29.648426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:29.649025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:29.649303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:29.649570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:29.651181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:29.722063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:29.760689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:29.762117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291164-e4cc-4d02-a3d6-34f001428467 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:29.780175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 673/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:32.216347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:32.216840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:32.216840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:32.218374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 653/1326] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:32.227174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836be6-e02d-48fc-9a97-be5950cf7aa9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:32.227676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836be6-e02d-48fc-9a97-be5950cf7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:32.227782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836be6-e02d-48fc-9a97-be5950cf7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:32.295039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6f836be6-e02d-48fc-9a97-be5950cf7aa9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:32.296233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6f836be6-e02d-48fc-9a97-be5950cf7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:32.396743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 674/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:32.685178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:32.686815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:32.752456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:32.796988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879fb1b-6c0c-4521-a100-c7a3bb11668e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:32.870323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:32.870943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:32.871213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:32.871477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:32.873095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:32.981658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:32.984372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:32.986369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e0411-4eb4-42a7-9769-05f7a765a4d7 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:33.004990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 654/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:35.213681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:35.214206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:35.214206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:35.215626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 675/1329] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:35.221038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442aaf0-1b50-40f2-8c76-0471fd9ee4b2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:35.221474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442aaf0-1b50-40f2-8c76-0471fd9ee4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:35.221587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442aaf0-1b50-40f2-8c76-0471fd9ee4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:35.292540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0442aaf0-1b50-40f2-8c76-0471fd9ee4b2 None None] MFA Rules not processed for user `2752d28631c647fcb7a8953e5c6ff7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:35.294356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0442aaf0-1b50-40f2-8c76-0471fd9ee4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:35.399648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 655/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:35.680913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:35.682546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:35.713273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:35.785203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09348f-98c4-49ce-b367-1aa8b1ecd420 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:35.861949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:35.862864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:35.863216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:35.863547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:35.865581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:35.948415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:35.983346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:35.984788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00992532-c8d8-49ec-b4f4-2e24e9021624 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:36.004143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 676/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:38.414757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:38.415251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:38.415360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:38.416678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 656/1332] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:38.421857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e729a1-0acd-4b50-ba75-8f5886d413fd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:38.422233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e729a1-0acd-4b50-ba75-8f5886d413fd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:38.422393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e729a1-0acd-4b50-ba75-8f5886d413fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:38.488873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b2e729a1-0acd-4b50-ba75-8f5886d413fd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:38.490003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b2e729a1-0acd-4b50-ba75-8f5886d413fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:38.586807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 677/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:38.869354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:38.870924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:38.940578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:38.980913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748bb2-36e9-4e96-8aca-ecfd39be1726 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:39.056332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:39.056930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:39.057198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:39.057460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:39.059083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:39.167453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:39.169464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1678-420d-4c29-bf3a-36125a29162d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:39.179393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:39.187533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 657/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:41.380312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:41.380746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:41.380848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:41.382236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 678/1335] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:41.387490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aaa11-a408-40c2-a95c-812e1b2442a5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:41.387895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aaa11-a408-40c2-a95c-812e1b2442a5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:41.388052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aaa11-a408-40c2-a95c-812e1b2442a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:41.453676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a03aaa11-a408-40c2-a95c-812e1b2442a5 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:41.454918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a03aaa11-a408-40c2-a95c-812e1b2442a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:41.555039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 658/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:41.841081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:41.842647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:41.881575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:41.943602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a84ed-9d46-4b1a-8b9c-0dfde3965fe6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:42.015839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:42.016433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:42.016709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:42.016977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:42.018576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:42.101746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:42.128043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:42.129476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05774dc-576f-4126-a78c-5730dc1cbe32 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:42.147905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 679/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:44.599543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:44.600089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:44.600089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:44.601411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 659/1338] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:44.607027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae513b-ac79-44e6-ad02-b93a1673a630 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:44.607466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae513b-ac79-44e6-ad02-b93a1673a630 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:44.607571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae513b-ac79-44e6-ad02-b93a1673a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:44.671952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-21ae513b-ac79-44e6-ad02-b93a1673a630 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:44.673574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-21ae513b-ac79-44e6-ad02-b93a1673a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:44.768951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 680/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:45.053236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:45.054869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:45.131686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:45.161627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3022650-7665-4089-b7e4-742593c3cc9e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:45.237698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:45.238292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:45.238590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:45.238856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:45.240422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:45.353245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:45.354635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e651f1d-957c-44aa-9f9c-e4d881d2d9f5 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:45.373266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 660/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:49.754547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:49.755140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:49.755140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:49.756438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 681/1341] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:49.762084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98b06-69f8-4548-adc6-c4fc1350bd4c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:49.762614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98b06-69f8-4548-adc6-c4fc1350bd4c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:49.762711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d98b06-69f8-4548-adc6-c4fc1350bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:49.768435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:49.835597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f6d98b06-69f8-4548-adc6-c4fc1350bd4c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:49.836719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f6d98b06-69f8-4548-adc6-c4fc1350bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:49.940077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 661/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:50.225864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:50.227513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:50.278789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:50.342887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373096-f3a7-4096-995c-f860f66e3766 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:50.427137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:50.428003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:50.428280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:50.428548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:50.430123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:50.521745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:50.538396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:50.539840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb6a99-c464-4e45-bf5c-87a9cfd8d847 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:50.558858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 682/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:53.302054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:53.302675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:53.302675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:53.303959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 662/1344] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:53.309312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f785e1-8e33-4a48-a83e-773a1e84a0bd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:53.309722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f785e1-8e33-4a48-a83e-773a1e84a0bd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:53.309888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f785e1-8e33-4a48-a83e-773a1e84a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:53.381917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f9f785e1-8e33-4a48-a83e-773a1e84a0bd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:53.383221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9f785e1-8e33-4a48-a83e-773a1e84a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:53.477424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 683/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:53.757080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:53.758691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:53.850412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:53.867825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f420bc-407f-4f87-a50f-4ed87c496d7d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:53.947763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:53.948630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:53.948902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:53.950020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:53.951641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:54.066201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:54.067666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfc132-18a1-4436-911e-e9ce78a76fcb service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:54.088290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 663/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:05:58.503198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:58.503739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:58.503969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:58.505406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 684/1347] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:05:58.511032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9751-0c18-46af-b3db-482a9893b25d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:58.511548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9751-0c18-46af-b3db-482a9893b25d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:58.511974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9751-0c18-46af-b3db-482a9893b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:58.530881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:58.591968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-64dc9751-0c18-46af-b3db-482a9893b25d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:05:58.593209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-64dc9751-0c18-46af-b3db-482a9893b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:58.692355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 664/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:05:58.973181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:05:58.974763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:59.031740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:59.076586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021887cd-17c5-4ae0-8808-145f70a58ddf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:05:59.149082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:05:59.149680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:05:59.149950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:05:59.150298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:05:59.152622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:05:59.255345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:05:59.259442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:05:59.260860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9cac7-89e5-425a-b5ac-d31bbca6edbe service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:05:59.279340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 685/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:04.152607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029bcc3-cf01-465d-929d-eeb3edb703a3 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:04.153075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029bcc3-cf01-465d-929d-eeb3edb703a3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:04.153194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029bcc3-cf01-465d-929d-eeb3edb703a3 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:04.155061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 665/1350] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:04.160090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1239999-09b9-4c00-abc7-fb339cb61806 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:04.161287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1239999-09b9-4c00-abc7-fb339cb61806 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:04.161766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1239999-09b9-4c00-abc7-fb339cb61806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:04.259170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e1239999-09b9-4c00-abc7-fb339cb61806 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:04.262277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e1239999-09b9-4c00-abc7-fb339cb61806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:04.465984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 686/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:08.638505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98220-f36a-441a-b7ad-7baad19b2146 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:08.639062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98220-f36a-441a-b7ad-7baad19b2146 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:08.639062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98220-f36a-441a-b7ad-7baad19b2146 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:08.640624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 666/1352] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:08.645293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3a77-cd79-405f-9ed3-9e7e4ab5fa09 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:08.645691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3a77-cd79-405f-9ed3-9e7e4ab5fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:08.645905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3a77-cd79-405f-9ed3-9e7e4ab5fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:08.690891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=59 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:08.702917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:08.726638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-95fc3a77-cd79-405f-9ed3-9e7e4ab5fa09 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:08.727948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-95fc3a77-cd79-405f-9ed3-9e7e4ab5fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:08.841362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 687/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:10.274339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858974ec-b3a0-4cbd-8cbd-12e495c299eb None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:10.274915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858974ec-b3a0-4cbd-8cbd-12e495c299eb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:10.274997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858974ec-b3a0-4cbd-8cbd-12e495c299eb None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:10.277251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 667/1354] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:10.281915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b059-c330-419a-9f51-709517f57cc2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:10.282344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b059-c330-419a-9f51-709517f57cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:10.282460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b059-c330-419a-9f51-709517f57cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:10.364144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3cc6b059-c330-419a-9f51-709517f57cc2 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:10.365393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3cc6b059-c330-419a-9f51-709517f57cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:10.408291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:10.477511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 688/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:06:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:06:13.917790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3e5-39dc-4f6e-abba-0214c14031e6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:13.918775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3e5-39dc-4f6e-abba-0214c14031e6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:13.919287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3e5-39dc-4f6e-abba-0214c14031e6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:13.924630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 668/1356] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:13.927054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10dd22-3b50-48ee-9fb3-900b169d3147 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:13.927740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10dd22-3b50-48ee-9fb3-900b169d3147 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:13.927740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10dd22-3b50-48ee-9fb3-900b169d3147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:14.000840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ba10dd22-3b50-48ee-9fb3-900b169d3147 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:14.001940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ba10dd22-3b50-48ee-9fb3-900b169d3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:14.105955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 689/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:14.407551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:14.408360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:14.409197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:14.412723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 669/1358] 10.222.0.27 () {54 vars in 965 bytes} [Mon Sep 19 16:06:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:14.419575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5120-2db8-406a-8805-a154f60d99d0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:14.419864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5120-2db8-406a-8805-a154f60d99d0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:14.420133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5120-2db8-406a-8805-a154f60d99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:14.439067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:14.508933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3daa5120-2db8-406a-8805-a154f60d99d0 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:14.510194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3daa5120-2db8-406a-8805-a154f60d99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:14.635044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 690/1359] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Sep 19 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:14.642867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:14.644778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:14.811333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8b56a-bad9-4e55-969d-bf54dbbb10d3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:14.898017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:14.941749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:14.942418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:14.942699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:14.942903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:14.944542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:15.058157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:15.060036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f74b4-9ec9-4203-8c0b-beb9a1c3ca39 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:15.082196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 670/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:17.488901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:17.489473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:17.489473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:17.494532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 691/1361] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:17.496767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf76a5-624a-4314-a3da-8a6a18351f00 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:17.497200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf76a5-624a-4314-a3da-8a6a18351f00 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:17.497287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf76a5-624a-4314-a3da-8a6a18351f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:17.568626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6bdf76a5-624a-4314-a3da-8a6a18351f00 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:17.569956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6bdf76a5-624a-4314-a3da-8a6a18351f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:17.609177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:17.673760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 671/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:17.970609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:17.972315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:18.052936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:18.151529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad4c1-31a9-40e5-a5aa-ccdc67a9412c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:18.276981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:18.277591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:18.277859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:18.278127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:18.279757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:18.303032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:18.376885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:18.379255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e8111-4133-49be-8e71-f565989b17cf service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:18.397046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 692/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:20.880510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8e00-7888-40bf-9579-2c918450526e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:20.881032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8e00-7888-40bf-9579-2c918450526e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:20.881113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8e00-7888-40bf-9579-2c918450526e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:20.882887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 672/1364] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:20.887936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971cf4-728b-4924-a163-fbe7c57f133a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:20.888407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971cf4-728b-4924-a163-fbe7c57f133a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:20.888531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971cf4-728b-4924-a163-fbe7c57f133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:20.957110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-17971cf4-728b-4924-a163-fbe7c57f133a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:20.958211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-17971cf4-728b-4924-a163-fbe7c57f133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:21.061600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:21.074791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 693/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:21.352234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:21.352523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:21.352860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:21.358162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 673/1366] 10.222.0.27 () {54 vars in 965 bytes} [Mon Sep 19 16:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:21.364575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cda2c-24c7-4196-b8d7-7c96837c1e20 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:21.364864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cda2c-24c7-4196-b8d7-7c96837c1e20 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:21.365147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cda2c-24c7-4196-b8d7-7c96837c1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:21.448826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-de9cda2c-24c7-4196-b8d7-7c96837c1e20 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:21.450098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-de9cda2c-24c7-4196-b8d7-7c96837c1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:21.582262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 694/1367] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Sep 19 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:21.591074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:21.592671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:21.751098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf501-919e-434d-ba10-2161cf46e082 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:21.771977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:21.881234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:21.881895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:21.882158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:21.882346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:21.883956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:21.985482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:21.987380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff357e7e-2f1d-49c6-9a32-8890ff2b5872 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:22.005940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 674/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:22.065403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0b9b-f15d-42b7-969e-43d9c5d99876 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:22.065893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0b9b-f15d-42b7-969e-43d9c5d99876 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:22.065997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0b9b-f15d-42b7-969e-43d9c5d99876 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:22.067295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 695/1369] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:22.072555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692955-4c18-49cc-8313-15dd69ed4c95 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:22.072837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692955-4c18-49cc-8313-15dd69ed4c95 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:22.073104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692955-4c18-49cc-8313-15dd69ed4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:22.110926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:22.160472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b0692955-4c18-49cc-8313-15dd69ed4c95 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:22.161673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b0692955-4c18-49cc-8313-15dd69ed4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:22.287578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 675/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:06:22.645737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:22.645737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:22.646180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:22.647916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 696/1371] 10.222.0.27 () {54 vars in 962 bytes} [Mon Sep 19 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:22.652724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634c9af-bf54-4751-90f1-a4ab4d3e53fe None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:22.653359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634c9af-bf54-4751-90f1-a4ab4d3e53fe None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:22.653707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634c9af-bf54-4751-90f1-a4ab4d3e53fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:22.735816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8634c9af-bf54-4751-90f1-a4ab4d3e53fe None None] MFA Rules not processed for user `51a2f331dfa2463a9af3282f8d9569e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:22.737079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8634c9af-bf54-4751-90f1-a4ab4d3e53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:22.789682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:22.824951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 676/1372] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Sep 19 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:22.833072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:22.834622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:22.889501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:22.949210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ae265-9d1c-44f9-ae4a-98574f26dd54 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:23.039699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:23.040305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:23.040729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:23.041008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:23.043248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:23.172827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:23.190184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:23.192071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5c580-f167-4bd6-9ae5-5e7bb0075270 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:23.222626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 697/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:24.275945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:24.276469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:24.276469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:24.277801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 677/1374] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:24.283062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2f38-7d4e-4310-896c-01a5ebbf004f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:24.283451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2f38-7d4e-4310-896c-01a5ebbf004f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:24.283622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2f38-7d4e-4310-896c-01a5ebbf004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:24.357833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-739c2f38-7d4e-4310-896c-01a5ebbf004f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:24.359286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-739c2f38-7d4e-4310-896c-01a5ebbf004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:24.456447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 698/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:24.751187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:24.752739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:24.914457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d6625-38ab-468d-9679-75d559c4a528 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:24.970256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:25.036107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:25.036738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:25.037017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:25.037287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:25.038959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:25.135702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:25.137354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbc37-6d31-4dca-b3c7-88a20a1ffc9e service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:25.156854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 678/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:27.343728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:27.344242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:27.344242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:27.345654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 699/1377] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:27.350802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d13ef-4e14-4617-8b92-4a47074837aa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:27.351208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d13ef-4e14-4617-8b92-4a47074837aa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:27.351345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d13ef-4e14-4617-8b92-4a47074837aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:27.419598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-011d13ef-4e14-4617-8b92-4a47074837aa None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:27.420809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-011d13ef-4e14-4617-8b92-4a47074837aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:27.428475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:27.526977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 679/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:27.811492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:27.813207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:27.878913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:27.972392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6b2b-21f6-44ed-aace-57c1e607797d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:28.094250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:28.095009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:28.095391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:28.095766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:28.097483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:28.117969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:28.196046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:28.198340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1ef5-16d5-46ef-b29c-8eeeff0fd7f7 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:28.218251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 700/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:30.435989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:30.436537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:30.436537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:30.437995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 680/1380] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:30.443049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3984b-d31d-4a59-a8f8-eea2f78026ac None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:30.443435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3984b-d31d-4a59-a8f8-eea2f78026ac None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:30.443598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3984b-d31d-4a59-a8f8-eea2f78026ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:30.513166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-69a3984b-d31d-4a59-a8f8-eea2f78026ac None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:30.514352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-69a3984b-d31d-4a59-a8f8-eea2f78026ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:30.621916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:30.643259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 701/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:30.922087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:30.923789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:31.080171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:31.090441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab30f-ce16-4035-a7c6-facbd43745a1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:31.213698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:31.214566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:31.214873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:31.215186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:31.217088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:31.322131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:31.323778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560f653-863f-4bea-9dd6-c99283f7a7d2 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:31.333778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:31.343817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 681/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:33.592025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:33.592605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:33.592605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:33.593916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 702/1383] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:33.599334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56139-6555-4928-9911-ddc23ecf4a7c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:33.599853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56139-6555-4928-9911-ddc23ecf4a7c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:33.599853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56139-6555-4928-9911-ddc23ecf4a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:33.667761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-05a56139-6555-4928-9911-ddc23ecf4a7c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:33.668955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-05a56139-6555-4928-9911-ddc23ecf4a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:33.769536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 682/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:34.062430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:34.064368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:34.220108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee062b82-81d2-49ae-916d-057b8673e269 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:34.288910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:34.339970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:34.340703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:34.340977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:34.341280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:34.343194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:34.438999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:34.440684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0e5d3-c054-4990-bd3f-882d6d1c1af2 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:34.459425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 703/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:36.672141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:36.672674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:36.672674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:36.677863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 683/1386] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:36.679810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b99a3-b895-488f-a1c2-8bf55211ee32 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:36.680247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b99a3-b895-488f-a1c2-8bf55211ee32 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:36.680368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b99a3-b895-488f-a1c2-8bf55211ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:36.753217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-924b99a3-b895-488f-a1c2-8bf55211ee32 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:36.754706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-924b99a3-b895-488f-a1c2-8bf55211ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:36.791346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:36.858842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 704/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:37.153083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:37.154692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:37.241061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:37.315156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c3918-dc5b-411f-b4cd-c9e1501e7056 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:37.437762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:37.438280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:37.438586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:37.438893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:37.440884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:37.481210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:37.533538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:37.535191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7fcc4-5af3-43c5-a468-6792e5457fd0 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:37.553372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 684/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:39.984405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:39.984989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:39.984989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:39.986537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 705/1389] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:39.991827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155ffa-3731-4f06-a95e-89e8f10d7391 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:39.992265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155ffa-3731-4f06-a95e-89e8f10d7391 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:39.992466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155ffa-3731-4f06-a95e-89e8f10d7391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:40.061169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-56155ffa-3731-4f06-a95e-89e8f10d7391 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:40.062412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56155ffa-3731-4f06-a95e-89e8f10d7391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:40.161145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 685/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:06:40.449482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:40.451202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:40.597003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fed34-f43c-4b11-8206-85ae9aacd5a7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:40.614726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:40.722170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:40.722852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:40.723378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:40.723378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:40.724953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:40.815249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:40.816859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fe808-be6d-425c-9b62-23c00d1bcba9 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:40.835175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 706/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:43.037118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:43.037664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:43.037664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:43.039069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 686/1392] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:43.045249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9166a-492e-44f2-8707-374282f1e906 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:43.045715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9166a-492e-44f2-8707-374282f1e906 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:43.045810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9166a-492e-44f2-8707-374282f1e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:43.072856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:43.115976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-39d9166a-492e-44f2-8707-374282f1e906 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:43.117193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-39d9166a-492e-44f2-8707-374282f1e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:43.216778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 707/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:43.517085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:43.518706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:43.533779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:43.672350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4aada-d1de-44a7-92e3-10d7383d5e26 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:43.762340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:43.790128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:43.790765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:43.791040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:43.791305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:43.792919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:43.885368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:43.886975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b68b0-049c-490b-9a78-7fa574f63e01 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:43.905324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 687/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:46.105975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:46.106507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:46.106507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:46.107924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 708/1395] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:46.113612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047f8a-a420-4c5d-a2e9-e6b6b4cc2b8f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:46.114053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047f8a-a420-4c5d-a2e9-e6b6b4cc2b8f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:46.114153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047f8a-a420-4c5d-a2e9-e6b6b4cc2b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:46.188817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-62047f8a-a420-4c5d-a2e9-e6b6b4cc2b8f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:46.190310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-62047f8a-a420-4c5d-a2e9-e6b6b4cc2b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:46.244177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:46.292922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 688/1396] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:46.619753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:46.621261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:46.720916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:46.775673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa606-283e-4f86-aad7-5eb40d448f72 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:46.887869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:46.888392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:46.888668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:46.888936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:46.890526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:46.955995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:46.984349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:46.985949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3c59b-5cd6-4822-b42b-def64573a48e service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:47.003602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 709/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:48.649128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bd91-3c93-47b9-941f-d53ca51393ac None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:48.649730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bd91-3c93-47b9-941f-d53ca51393ac None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:48.649730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bd91-3c93-47b9-941f-d53ca51393ac None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:48.651082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 689/1398] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:48.656478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267410f1-2ad4-4fde-9c89-2a3ee762231b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:48.656915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267410f1-2ad4-4fde-9c89-2a3ee762231b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:48.657337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267410f1-2ad4-4fde-9c89-2a3ee762231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:48.724139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-267410f1-2ad4-4fde-9c89-2a3ee762231b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:48.725329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-267410f1-2ad4-4fde-9c89-2a3ee762231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:48.823861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 710/1399] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:06:49.124372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c29b-a0a5-4a8c-9cd5-62a8fcac7a8e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.124644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c29b-a0a5-4a8c-9cd5-62a8fcac7a8e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.124916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c29b-a0a5-4a8c-9cd5-62a8fcac7a8e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.126292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 690/1400] 10.222.0.27 () {54 vars in 962 bytes} [Mon Sep 19 16:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:49.131608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.132043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.132321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.180540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:49.205787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885425-1f8f-4f7b-9b3c-577e0cf833ab None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.206062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885425-1f8f-4f7b-9b3c-577e0cf833ab None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.206329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885425-1f8f-4f7b-9b3c-577e0cf833ab None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.207707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 691/1401] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:06:49.212580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] MFA Rules not processed for user `50a08aac9b9240338d0fec3b5ce7e285`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:49.212779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.213048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.213309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.213775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:49.280123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:49.281361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:49.289663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 711/1402] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Sep 19 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:49.299384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:49.307575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1314e-543b-417a-969a-74c093cfdc9e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:49.386361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 692/1403] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:06:49.387011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:49.387620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.387895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.388163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.389754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:49.444906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:49.500787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:49.502225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930d12c-6e42-4bc7-9775-925c6d49bc47 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:49.519767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 712/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:06:49.673342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:49.674670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:49.711371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:49.800676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b8a00-c407-4865-9b16-f87fe786de90 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:49.929847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:49.930361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:49.930686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:49.930953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:49.932594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:49.970472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:50.032856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:50.034492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685badc4-6530-4607-9d6b-4b267eea1d11 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:50.053602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 693/1405] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:06:50.269116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9104-5c10-41fe-ad1e-269e632b0fe8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:50.269700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9104-5c10-41fe-ad1e-269e632b0fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:50.269791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb9104-5c10-41fe-ad1e-269e632b0fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:50.341671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-48bb9104-5c10-41fe-ad1e-269e632b0fe8 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:50.342887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-48bb9104-5c10-41fe-ad1e-269e632b0fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:50.432481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 713/1406] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:50.477635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:50.477920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:50.478194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:50.479626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 694/1407] 10.222.0.27 () {54 vars in 943 bytes} [Mon Sep 19 16:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:06:50.488387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920088-cac2-4ea5-9e91-051ca96d377f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:50.488695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920088-cac2-4ea5-9e91-051ca96d377f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:50.488973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf920088-cac2-4ea5-9e91-051ca96d377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:50.516474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:50.568424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cf920088-cac2-4ea5-9e91-051ca96d377f None None] MFA Rules not processed for user `81bce1766c4c4ed09127855dd79ec9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:06:50.569615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cf920088-cac2-4ea5-9e91-051ca96d377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:50.683299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 714/1408] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Sep 19 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:06:50.692728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:06:50.694163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:50.829125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ce79-c893-4d43-af4a-3b462eb12a75 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:06:50.846306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:06:50.932946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:06:50.933546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:06:50.933821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:06:50.934090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:06:50.935745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:06:51.018286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:06:51.019910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879d72-c512-4284-9ab2-ad7236360b85 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:06:51.028370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 695/1409] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:06:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:07:00.681758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=65 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:01.024554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=78 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:13.537832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981dc6-8691-4cc9-88aa-b397b650b6b3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:13.538368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981dc6-8691-4cc9-88aa-b397b650b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:13.538368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981dc6-8691-4cc9-88aa-b397b650b6b3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:13.540372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 715/1410] 10.222.0.27 () {54 vars in 918 bytes} [Mon Sep 19 16:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:13.546731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a72d-b924-4c9c-959c-5548609f73e0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:13.547161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a72d-b924-4c9c-959c-5548609f73e0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:13.547312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a72d-b924-4c9c-959c-5548609f73e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:13.629970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7498a72d-b924-4c9c-959c-5548609f73e0 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:13.631086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7498a72d-b924-4c9c-959c-5548609f73e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:13.736232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 696/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Sep 19 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:13.750476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd170-d171-4750-b90b-81ffc924a48b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:13.750779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd170-d171-4750-b90b-81ffc924a48b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:13.751077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dd170-d171-4750-b90b-81ffc924a48b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:13.752410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 716/1412] 10.222.0.27 () {54 vars in 918 bytes} [Mon Sep 19 16:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:13.757011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a285d-9b81-4983-ba8b-aacd2acbd655 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:13.757290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a285d-9b81-4983-ba8b-aacd2acbd655 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:13.757555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a285d-9b81-4983-ba8b-aacd2acbd655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:13.830937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:13.833894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-750a285d-9b81-4983-ba8b-aacd2acbd655 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:13.835742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-750a285d-9b81-4983-ba8b-aacd2acbd655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:13.953882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 697/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Sep 19 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:16.513659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:16.514137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:16.514137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:16.515498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:16.520972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddac67-c732-46c5-b687-4183307d5ac9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:16.521372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddac67-c732-46c5-b687-4183307d5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:16.521545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddac67-c732-46c5-b687-4183307d5ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:16.590247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6eddac67-c732-46c5-b687-4183307d5ac9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:16.591516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6eddac67-c732-46c5-b687-4183307d5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:16.651135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:16.693321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:07:16.979479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:16.981006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:17.126581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166e8b1-567c-4de4-8974-60af40f7fe02 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:17.198163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:17.238018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:17.238572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:17.238845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:17.239109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:17.240678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:17.329206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:17.330842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47eb63-fe58-4f18-b5d0-3969bb1ce46a service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:17.349531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 718/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:18.498019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:18.498584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:18.498584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:18.499830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:18.505886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f26d7c-2a7d-4d71-b047-1b1147beeeb2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:18.506310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f26d7c-2a7d-4d71-b047-1b1147beeeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:18.506413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f26d7c-2a7d-4d71-b047-1b1147beeeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:18.580526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-10f26d7c-2a7d-4d71-b047-1b1147beeeb2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:18.581705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-10f26d7c-2a7d-4d71-b047-1b1147beeeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:18.609854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:18.680253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:18.828239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:18.829772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:18.972657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ff69f-6c97-4f20-a88e-1fd5238db40e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:19.013040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:19.085791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:19.086831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:19.087104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:19.087368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:19.088950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:19.176976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:19.178576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664477d-0fb3-4fcc-8d38-4e4b8f3f5136 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:19.196458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 700/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:20.336795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:20.337377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:20.337377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:20.338682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:20.344878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e1f6-5458-4745-afef-f38227f19a24 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:20.345288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e1f6-5458-4745-afef-f38227f19a24 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:20.345426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663e1f6-5458-4745-afef-f38227f19a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:20.399900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:20.422323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d663e1f6-5458-4745-afef-f38227f19a24 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:20.423548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d663e1f6-5458-4745-afef-f38227f19a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:20.517291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:07:20.666885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:20.668448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:20.810535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338be6fc-d4cd-4a39-b93d-471082c50ab9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:20.822843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:20.924310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:20.924907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:20.925183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:20.925467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:20.927066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:21.015078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:21.016680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d35360-a903-4e3a-a90d-0944f655c1f2 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:21.034231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 721/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:22.158631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:22.159198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:22.159198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:22.160527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:22.167273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db351e-0f6b-41e3-8eea-fb9f4c50f06a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:22.167689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db351e-0f6b-41e3-8eea-fb9f4c50f06a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:22.167813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db351e-0f6b-41e3-8eea-fb9f4c50f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:22.191299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:22.254751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-41db351e-0f6b-41e3-8eea-fb9f4c50f06a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:22.255949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-41db351e-0f6b-41e3-8eea-fb9f4c50f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:22.351651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:22.504312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:22.505733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:22.614243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:22.650775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03a51-c5af-4c4c-87fe-fb03285d098c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:22.761769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:22.762277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:22.762611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:22.762846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:22.764415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:22.838418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:22.852022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:22.854177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de91ae-d2b9-48c2-86ba-b2d4090115b4 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:22.872282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 703/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:24.000274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:24.000928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:24.000928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:24.002147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:24.008619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2973-1f94-4d62-8139-50c790307f3e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:24.009707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2973-1f94-4d62-8139-50c790307f3e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:24.009819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2973-1f94-4d62-8139-50c790307f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:24.086417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-296a2973-1f94-4d62-8139-50c790307f3e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:24.087653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-296a2973-1f94-4d62-8139-50c790307f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:24.182421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:24.331879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:24.333387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:24.416813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:24.478176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60106b-ff37-49e7-97d8-10e26549cbb7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:24.589759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:24.590280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:24.590588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:24.590863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:24.592478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:24.640553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:24.682170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:24.684245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32cf65-697a-40e9-9065-b12459703131 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:24.701774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 724/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:25.767361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:25.767881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:25.767881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:25.769175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:07:25.775309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f89-d184-4343-9f05-a31e68d9e98a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:25.775770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f89-d184-4343-9f05-a31e68d9e98a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:25.775958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f89-d184-4343-9f05-a31e68d9e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:25.853796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e6c80f89-d184-4343-9f05-a31e68d9e98a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:25.855034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6c80f89-d184-4343-9f05-a31e68d9e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:25.949739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:26.097512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:26.099105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:26.152419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:26.251054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404bc8c-9393-4d1b-ae07-9a052d6d61b4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:26.365917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:26.366556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:26.366831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:26.367095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:26.368720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:26.375884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:26.457898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:26.459598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173bea6-ecf5-47b0-82aa-1d9827c792ed service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:26.478108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 706/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:27.560413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:27.560983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:27.560983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:27.562337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:27.569114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29690-59a5-4e13-b9de-1091166b5028 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:27.569541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29690-59a5-4e13-b9de-1091166b5028 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:27.569656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29690-59a5-4e13-b9de-1091166b5028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:27.644691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-afe29690-59a5-4e13-b9de-1091166b5028 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:27.645799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-afe29690-59a5-4e13-b9de-1091166b5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:27.713701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:27.743623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:27.892714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:27.894241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:27.912195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:28.038442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14baea-8a58-498f-b281-30824d0553bc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:28.123918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:28.150038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:28.150667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:28.150946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:28.151217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:28.153337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:28.243205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:28.244723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3f8f9-77c2-45d0-b6fd-0712feeffb55 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:28.263009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 727/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:29.315342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:29.315884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:29.315884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:29.317222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:29.323464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b230c8-a9f1-4d4b-a1a0-4def45412ab5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:29.323956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b230c8-a9f1-4d4b-a1a0-4def45412ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:29.324061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b230c8-a9f1-4d4b-a1a0-4def45412ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:29.399787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-32b230c8-a9f1-4d4b-a1a0-4def45412ab5 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:29.401025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32b230c8-a9f1-4d4b-a1a0-4def45412ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:29.442548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:29.496034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:29.651132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:29.653141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:29.800123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cef87-a746-4901-a82c-e22dcc32db04 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:29.854425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:29.913221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:29.913775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:29.914047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:29.914317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:29.915921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:30.006456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:30.008107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd24bc0-3ea1-436f-a255-ed0288cc6880 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:30.026669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 709/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:31.070797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:31.071371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:31.071371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:31.072673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:31.079030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465ad4-e715-413d-82b0-4bb7d5eaa063 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:31.079441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465ad4-e715-413d-82b0-4bb7d5eaa063 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:31.079575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465ad4-e715-413d-82b0-4bb7d5eaa063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:31.155364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-96465ad4-e715-413d-82b0-4bb7d5eaa063 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:31.156567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96465ad4-e715-413d-82b0-4bb7d5eaa063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:31.158619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:31.253642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:31.404884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:31.406382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:31.549174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591f964-7c44-4a1f-a9f1-ca55a06404d0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:31.576234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:31.663695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:31.664200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:31.664471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:31.664735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:31.666365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:31.753172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:31.754805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b99c-41c9-4608-9948-8525dcba3c63 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:31.772713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 730/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:33.835732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:33.836327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:33.836327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:33.837592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:33.842893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ee6c-f69a-4450-b3ee-926102de0ef0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:33.843324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ee6c-f69a-4450-b3ee-926102de0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:33.843440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ee6c-f69a-4450-b3ee-926102de0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:33.883394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:33.909814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aeb1ee6c-f69a-4450-b3ee-926102de0ef0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:33.911054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aeb1ee6c-f69a-4450-b3ee-926102de0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:34.005123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:34.288681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:34.290243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:34.397803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035725-cda8-4972-b0c9-6cef4c3b1ad4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:34.436255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:34.478116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:34.478743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:34.479020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:34.479293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:34.481469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:34.590044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:34.592757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090c2e4-eec6-4b1f-bee8-cf918166d57b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:34.614662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 712/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:36.904507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:36.905078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:36.905078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:36.906393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:36.912542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b275c5-f3ed-4691-8328-2dacdf3cdc0e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:36.912995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b275c5-f3ed-4691-8328-2dacdf3cdc0e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:36.913130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b275c5-f3ed-4691-8328-2dacdf3cdc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:36.986456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3b275c5-f3ed-4691-8328-2dacdf3cdc0e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:36.987681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3b275c5-f3ed-4691-8328-2dacdf3cdc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:37.000368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:37.085002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:37.378000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:37.379579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:37.480572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210169f-3b79-4c92-8c3a-66c82f8dac25 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:37.492946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:37.562015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:37.562643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:37.562920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:37.563188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:37.564883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:37.688488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:37.689877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb979d7-45c6-4ff2-8ca9-f4470c5c7118 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:37.708182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 733/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:40.200903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:40.201468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:40.201468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:40.202809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:40.208061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820500-0a7c-45f3-ba1b-466a19eed5d5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:40.208487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820500-0a7c-45f3-ba1b-466a19eed5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:40.208627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820500-0a7c-45f3-ba1b-466a19eed5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:40.256390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:40.274894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-04820500-0a7c-45f3-ba1b-466a19eed5d5 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:40.276097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-04820500-0a7c-45f3-ba1b-466a19eed5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:40.372408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:40.657281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:40.658881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:40.765580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494abc49-6bc5-4bfe-a486-857f076c5cf0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:40.806653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:40.841470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:40.842061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:40.842337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:40.842637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:40.844223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:40.958672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:40.959999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9958fa-4ba4-41fc-9063-598358a36e80 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:40.978452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 715/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:43.261102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:43.261663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:43.261663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:43.263044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:43.268258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fec2-a8b8-4cb2-91be-a0498ff9992e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:43.268680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fec2-a8b8-4cb2-91be-a0498ff9992e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:43.268807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042fec2-a8b8-4cb2-91be-a0498ff9992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:43.335553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4042fec2-a8b8-4cb2-91be-a0498ff9992e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:43.336759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4042fec2-a8b8-4cb2-91be-a0498ff9992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:43.358277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:43.436526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:43.747028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:43.748575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:43.852639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499db6a-a59b-44b9-bff0-eb0f91fe988f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:43.872508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:43.926816 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:43.927427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:43.927726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:43.927966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:43.929730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:44.039997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:44.041442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97b8ca-8293-4d60-b1e2-f9e69857d738 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:44.060891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 736/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:46.274394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:46.274861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:46.274957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:46.276320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:46.281727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c954d-7766-408e-af60-ac8e5b7d126e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:46.282157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c954d-7766-408e-af60-ac8e5b7d126e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:46.282319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c954d-7766-408e-af60-ac8e5b7d126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:46.346155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:46.348906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-917c954d-7766-408e-af60-ac8e5b7d126e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:46.350750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-917c954d-7766-408e-af60-ac8e5b7d126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:46.448973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:46.733324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:46.734909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:46.837753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399462e-2c5e-4a38-bcfc-bb0b01b1a7d0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:46.887865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:46.911203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:46.911793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:46.912059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:46.912322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:46.913891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:47.021672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:47.023127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91e44c-9297-4ef9-b662-f45624d44a4b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:47.041153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 718/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:49.212077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:49.212671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:49.212671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:49.214017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:49.219708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a76f-b60e-4574-b678-7e6b80131b53 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:49.220127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a76f-b60e-4574-b678-7e6b80131b53 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:49.220249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a76f-b60e-4574-b678-7e6b80131b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:49.286710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-94a9a76f-b60e-4574-b678-7e6b80131b53 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:49.287904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-94a9a76f-b60e-4574-b678-7e6b80131b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:49.317634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:49.385601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:49.671097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:49.672910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:49.893016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47266-3a8f-4f6c-a207-39979d760881 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:49.921216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:49.967971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:49.968579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:49.968853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:49.969122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:49.970766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:50.083865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:50.085303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e27d-03ac-4382-812d-4c4df727d6f3 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:50.103682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 739/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:52.323237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:52.323844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:52.323844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:52.325215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:52.330640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8706f-45cb-4107-ba1e-cd5f0377a0f1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:52.331096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8706f-45cb-4107-ba1e-cd5f0377a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:52.331219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8706f-45cb-4107-ba1e-cd5f0377a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:52.395272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0ba8706f-45cb-4107-ba1e-cd5f0377a0f1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:52.396467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0ba8706f-45cb-4107-ba1e-cd5f0377a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:52.405061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:52.491848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:52.782288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:52.783860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:52.886680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e692e-09fd-43dd-b912-af858f73a9f5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:52.942419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:52.960738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:52.961332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:52.961605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:52.961872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:52.963487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:53.073207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:53.075153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3d3a-3370-4c12-b039-f7f1b3a58b4b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:53.093741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 721/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:07:55.353209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:55.353855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:55.353855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:55.355235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:55.362064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0373851-c296-462a-8bc6-8322fded50f7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:55.362526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0373851-c296-462a-8bc6-8322fded50f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:55.362817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0373851-c296-462a-8bc6-8322fded50f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:55.429760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c0373851-c296-462a-8bc6-8322fded50f7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:55.430978 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c0373851-c296-462a-8bc6-8322fded50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:55.468763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:55.526249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:55.814930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:55.816486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:55.920906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432c366-7899-44f6-9011-ac051dfbb396 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:55.958148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:55.993513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:55.994106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:55.994378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:55.994670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:55.996230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:56.103064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:56.104428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e851434-2352-4445-b1e9-9094da222640 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:56.122742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 742/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:07:58.319915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:58.320442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:58.320442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:58.321802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:07:58.327647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79cef-06c3-48e9-9e6c-9c5e11f20305 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:58.328089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79cef-06c3-48e9-9e6c-9c5e11f20305 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:58.328186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79cef-06c3-48e9-9e6c-9c5e11f20305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:58.394634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8fa79cef-06c3-48e9-9e6c-9c5e11f20305 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:07:58.395912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8fa79cef-06c3-48e9-9e6c-9c5e11f20305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:58.413489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:58.491169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:07:58.769622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:07:58.771197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:58.874902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930cad0-83da-406b-b33a-b190dfaa6632 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:07:58.941261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:07:58.948221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:07:58.948819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:07:58.949092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:07:58.949889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:07:58.951494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:07:59.175827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:07:59.177240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f10a5-b072-4ce1-a68a-6c60df3300f0 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:07:59.195724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 724/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:01.454065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:01.454642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:01.454642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:01.455968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:01.461335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa549-4c23-47b1-957c-e1ec3231caaf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:01.461759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa549-4c23-47b1-957c-e1ec3231caaf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:01.461863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aa549-4c23-47b1-957c-e1ec3231caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:01.527835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-994aa549-4c23-47b1-957c-e1ec3231caaf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:01.529028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-994aa549-4c23-47b1-957c-e1ec3231caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:01.584391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:01.634671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:01.914348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:01.915946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:02.019506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5fb3c-b47f-4e68-8c78-e8c6d695c0dd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:02.069166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:02.095446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:02.096040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:02.096319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:02.096587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:02.098169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:02.204989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:02.206352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a764d4-bd2f-4f66-a72c-2402a753ad12 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:02.224061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 745/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:11.633153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=22 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:12.221755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=66 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:22.201974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b0627-69f4-4773-a17b-56faaed847ad None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:22.202562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b0627-69f4-4773-a17b-56faaed847ad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:22.202562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b0627-69f4-4773-a17b-56faaed847ad None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:22.203839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 726/1471] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:22.209061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b250f-1f7e-4c7e-a7c1-0f0d0b3e0216 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:22.209444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b250f-1f7e-4c7e-a7c1-0f0d0b3e0216 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:22.209639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b250f-1f7e-4c7e-a7c1-0f0d0b3e0216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:22.274127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-773b250f-1f7e-4c7e-a7c1-0f0d0b3e0216 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:22.275277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-773b250f-1f7e-4c7e-a7c1-0f0d0b3e0216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:22.372010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 746/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:22.675663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:22.675940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:22.676206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:22.677528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 727/1473] 10.222.0.27 () {54 vars in 962 bytes} [Mon Sep 19 16:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:22.682551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276d6c-e284-49ca-b079-b18bcffc8758 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:22.683439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276d6c-e284-49ca-b079-b18bcffc8758 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:22.683724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276d6c-e284-49ca-b079-b18bcffc8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:22.759421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-db276d6c-e284-49ca-b079-b18bcffc8758 None None] MFA Rules not processed for user `50a08aac9b9240338d0fec3b5ce7e285`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:22.760608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-db276d6c-e284-49ca-b079-b18bcffc8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:22.780533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:22.835287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 747/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Sep 19 16:08:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:22.842963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:22.844488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:22.946568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb2621-7166-4406-a0d6-b6c50d9fd012 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:23.018728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:23.019314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:23.019587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:23.019852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:23.021408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:23.075860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:23.141671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:23.143124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af5dd2-80d7-454f-8230-9e7931264337 service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:23.161738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 728/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:08:25.380900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:25.381407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:25.381511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:25.382806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 748/1476] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:25.388565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41eaf0-e2c7-42f0-b605-a405b0224358 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:25.389023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41eaf0-e2c7-42f0-b605-a405b0224358 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:25.389130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41eaf0-e2c7-42f0-b605-a405b0224358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:25.456006 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0f41eaf0-e2c7-42f0-b605-a405b0224358 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:25.457201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f41eaf0-e2c7-42f0-b605-a405b0224358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:25.551720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 729/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:25.840527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:25.842051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:25.969638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fd7d6-c4d3-452e-ac4f-66576425c3c9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:26.016902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:26.061331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:26.061927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:26.062196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:26.062457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:26.063110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:26.064826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:08:26.064826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:08:26.064826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:08:26.065949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113ec12-8f94-47ea-abdc-4a8359ab406a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:26.085285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 749/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Sep 19 16:08:25 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:08:28.269393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:28.269924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:28.269924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:28.271310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 730/1479] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:28.277207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33009815-b519-4860-bf1e-9a1d255cde74 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:28.277594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33009815-b519-4860-bf1e-9a1d255cde74 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:28.278204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33009815-b519-4860-bf1e-9a1d255cde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:28.342613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-33009815-b519-4860-bf1e-9a1d255cde74 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:28.343799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-33009815-b519-4860-bf1e-9a1d255cde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:28.439212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 750/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:28.733752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:28.735342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:28.745235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:28.881907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a43a4-ffb4-4389-9d1b-77bfe6c1daa2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:28.960607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:28.992920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:28.993455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:28.993730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:28.993998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:28.995641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:29.086187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:29.087797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876085b9-5f65-43dc-8b63-58764a475990 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:29.105951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 731/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:31.438587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:31.439114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:31.439114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:31.440451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 751/1482] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:31.445926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1eb5b-c29c-4acf-8ce4-5e079ca9f6a3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:31.446373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1eb5b-c29c-4acf-8ce4-5e079ca9f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:31.446515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1eb5b-c29c-4acf-8ce4-5e079ca9f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:31.512347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-57f1eb5b-c29c-4acf-8ce4-5e079ca9f6a3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:31.513539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-57f1eb5b-c29c-4acf-8ce4-5e079ca9f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:31.559835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:31.610474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 732/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:31.900405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:31.902702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:31.931568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:32.008956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dca487-fe22-4c3b-9a5d-a26763cf2d1d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:32.082675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:32.083300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:32.083574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:32.083841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:32.085716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:32.160180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:32.196318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:32.197769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034370b-6f56-4544-996b-ead7e8b5a568 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:32.215925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 752/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:34.398760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:34.399267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:34.399386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:34.400634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 733/1485] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:34.406575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42135e4-b177-4b62-ba4a-1f2e17c5af63 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:34.407016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42135e4-b177-4b62-ba4a-1f2e17c5af63 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:34.407124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42135e4-b177-4b62-ba4a-1f2e17c5af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:34.472792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d42135e4-b177-4b62-ba4a-1f2e17c5af63 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:34.473990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d42135e4-b177-4b62-ba4a-1f2e17c5af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:34.574365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 753/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:34.862096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:34.863683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:34.970323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae3f2b-8245-4529-9890-5e255e051a31 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:35.041791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:35.043370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:35.043978 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:35.044313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:35.044757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:35.047124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:35.159431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:35.160809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a09c72-d6cc-4124-9c94-4f0b989d27a8 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:35.179348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 734/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:37.480140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:37.480700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:37.480700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:37.482009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 754/1488] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:37.487372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20e2b-0946-44d5-a4ed-0cac18da9bdd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:37.487791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20e2b-0946-44d5-a4ed-0cac18da9bdd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:37.487912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20e2b-0946-44d5-a4ed-0cac18da9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:37.553485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9be20e2b-0946-44d5-a4ed-0cac18da9bdd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:37.554741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9be20e2b-0946-44d5-a4ed-0cac18da9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:37.607481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:37.652343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 735/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:37.939954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:37.941502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:37.979372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:38.049028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727847ba-d196-4415-bd92-c670969cb6e5 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:38.128988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:38.129582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:38.129850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:38.130114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:38.131772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:38.210968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:38.241018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:38.242449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66f905-2d2d-4ddc-90f4-6c544f599f2b service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:38.261227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 755/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:40.642373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:40.642929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:40.642929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:40.644193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 736/1491] 10.222.0.27 () {54 vars in 927 bytes} [Mon Sep 19 16:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:08:40.649682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c064b-2f30-4983-bb25-2f97d0c9e5e4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:40.650103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c064b-2f30-4983-bb25-2f97d0c9e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:40.650214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c064b-2f30-4983-bb25-2f97d0c9e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:40.715730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1d5c064b-2f30-4983-bb25-2f97d0c9e5e4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:08:40.716926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1d5c064b-2f30-4983-bb25-2f97d0c9e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:40.815894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 756/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Sep 19 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:08:41.109189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:08:41.111120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:41.227590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf643-f59a-4a39-8c60-4d546615e3d1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:08:41.302124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:08:41.302740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:08:41.303014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:08:41.303278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:08:41.305039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:08:41.314235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:41.415653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:08:41.417676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6f94-b5cc-4bc4-9a90-6a4794823061 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:08:41.435333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 737/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:08:50.814330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=82 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:08:51.433088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=50 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:55.831215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:55.831784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:55.831784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:55.908999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:09:55.910184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.009991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 757/1494] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:09:56.019420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.019963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.019963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.101106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:09:56.102755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.198642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 738/1495] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:09:56.203253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:56.204446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.216511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ef888-4c51-49b7-af9e-74bff2145162 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:56.276399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:56.309582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:56.310176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.310449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.310747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.311376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:09:56.311675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:56.312680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:56.312680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:09:56.312680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:09:56.313639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:56.324376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 758/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:09:56.332732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:56.342376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758410b-f928-4f89-a353-fe4d6ec6dff1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:56.410647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:56.445663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:56.446280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.446626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.446896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.447513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:56.449227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:56.449227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:09:56.449227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:09:56.450436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:56.505392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 739/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:09:56 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:09:56.510153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:56.511824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.547813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b23b-805b-4ea3-a46d-9e8989534508 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:56.647966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:56.649121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.649396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.649662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.650288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:56.651319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:56.651319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:09:56.651319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:09:56.652510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:56.696276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 759/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:09:56 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:09:56.700546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:56.702097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.764426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c196d89-4517-44dd-9503-6225c822f5bc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:56.847454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:56.858290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:56.858919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.859187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.859452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.860069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:56.861065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:56.861065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:09:56.861065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:09:56.861933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:56.874622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 740/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:09:56.878774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:56.880313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:56.892246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0142-523b-4048-8dfd-9905c3a82fe7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:56.916501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:56.986659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:56.987258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:56.987531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:56.987799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:56.988432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:56.989445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:56.989445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:09:56.989445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:09:56.990326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb08f7-af21-4ab0-9f1a-90fd858c67a9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:57.002884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 760/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:09:57.007023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:57.009678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.044504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092737-3905-4afa-a718-86b3f59b1472 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:57.139002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:57.139570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.139843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.140112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] PATH_INFO: `/v3/projects/d0a8f55593f644bc827fbd8a3049354a/users/fdb1e887df024429bcc0a1ef73ba3cfa/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.162324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a8f55593f644bc827fbd8a3049354a, user_id=fdb1e887df024429bcc0a1ef73ba3cfa, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:57.163453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:57.163453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:09:57.163453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:09:57.165352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ae8f-4647-4bb4-ad61-a125575251e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:57.189421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 741/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:09:57 2022] PUT /identity/v3/projects/d0a8f55593f644bc827fbd8a3049354a/users/fdb1e887df024429bcc0a1ef73ba3cfa/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:09:57.202068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68025-f9bb-461d-949b-470fbc385d89 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.202456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68025-f9bb-461d-949b-470fbc385d89 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.202828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68025-f9bb-461d-949b-470fbc385d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.260422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-67b68025-f9bb-461d-949b-470fbc385d89 None None] MFA Rules not processed for user `fdb1e887df024429bcc0a1ef73ba3cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:09:57.261603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-67b68025-f9bb-461d-949b-470fbc385d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.336693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 761/1502] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:09:57.350113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.350395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.350693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.352907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 742/1503] 10.222.0.27 () {54 vars in 962 bytes} [Mon Sep 19 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:09:57.357757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8b1f-1949-4ad3-8779-5a6f7c64eef4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.358417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8b1f-1949-4ad3-8779-5a6f7c64eef4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.358417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8b1f-1949-4ad3-8779-5a6f7c64eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.389533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:57.434144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-87dd8b1f-1949-4ad3-8779-5a6f7c64eef4 None None] MFA Rules not processed for user `51a2f331dfa2463a9af3282f8d9569e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:09:57.435379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-87dd8b1f-1949-4ad3-8779-5a6f7c64eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.509260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 762/1504] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Sep 19 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:09:57.517923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:57.519468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.569483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:57.623808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de5ad-815f-4b39-b0f7-f2ded9b0512d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:57.698630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:57.699150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.699427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.699695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.701276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.816840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:57.818258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:57.821685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:57.837404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 743/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:09:57.882150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55328c-f884-4577-8d1f-95ad608aa688 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:57.882624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55328c-f884-4577-8d1f-95ad608aa688 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:57.882739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55328c-f884-4577-8d1f-95ad608aa688 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:57.883979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 763/1506] 10.222.0.27 () {52 vars in 830 bytes} [Mon Sep 19 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:09:57.887467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:57.888651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:57.987664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a94a-eac1-49da-a66b-0318ba62dc70 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:58.092212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:58.092918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:58.093100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:58.093364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] PATH_INFO: `/v3/users/fdb1e887df024429bcc0a1ef73ba3cfa` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:58.107236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb1e887df024429bcc0a1ef73ba3cfa)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:58.108257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:58.108257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:09:58.108257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:09:58.109459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:58.119287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:58.174526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb1e887df024429bcc0a1ef73ba3cfa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:58.183147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb1e887df024429bcc0a1ef73ba3cfa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:58.183565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb1e887df024429bcc0a1ef73ba3cfa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:58.184052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb1e887df024429bcc0a1ef73ba3cfa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:58.198353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb1e887df024429bcc0a1ef73ba3cfa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:58.226441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 744/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:09:57 2022] DELETE /identity/v3/users/fdb1e887df024429bcc0a1ef73ba3cfa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:09:58.230689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6217-2055-4675-9e14-113b019d0fea None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:58.230967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6217-2055-4675-9e14-113b019d0fea None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:58.231237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6217-2055-4675-9e14-113b019d0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:58.288090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-742f6217-2055-4675-9e14-113b019d0fea None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:09:58.289290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-742f6217-2055-4675-9e14-113b019d0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:58.365907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:58.379154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 764/1508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:09:58.389350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:58.390587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:58.491278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf74d5-9025-4b8b-9b8a-85ace7160d1d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:58.544564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:09:58.565179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:58.565781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:58.566051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:58.566314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:58.567924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:58.673478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:58.674935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cffde-a4e4-4ced-b39c-1d12b955c978 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:58.692847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 745/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:09:59.051418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6217-2055-4675-9e14-113b019d0fea None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:09:59.052669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-742f6217-2055-4675-9e14-113b019d0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:09:59.066026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6217-2055-4675-9e14-113b019d0fea None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:09:59.166282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:09:59.166928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:09:59.167205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:09:59.167470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] PATH_INFO: `/v3/projects/d0a8f55593f644bc827fbd8a3049354a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:09:59.177276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a8f55593f644bc827fbd8a3049354a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:09:59.178297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:09:59.178297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:09:59.178297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:09:59.179583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:09:59.238069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a8f55593f644bc827fbd8a3049354a', 'request_id': 'req-6721db2a-0843-4d6e-8864-1bd46ec7429d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:59.247179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a8f55593f644bc827fbd8a3049354a', 'request_id': 'req-6721db2a-0843-4d6e-8864-1bd46ec7429d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:59.253166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a8f55593f644bc827fbd8a3049354a', 'request_id': 'req-6721db2a-0843-4d6e-8864-1bd46ec7429d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:59.282021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] The token cache is being invalidate because project d0a8f55593f644bc827fbd8a3049354a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:09:59.282301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:59.282745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6721db2a-0843-4d6e-8864-1bd46ec7429d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:09:59.284106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 765/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:09:59 2022] DELETE /identity/v3/projects/d0a8f55593f644bc827fbd8a3049354a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:10:08.690759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=62 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:10:09.280016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:37.254758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:37.255580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:37.255580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:37.256746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:37.262699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f9da-2580-40d1-95e6-18e4d192d045 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:37.263388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f9da-2580-40d1-95e6-18e4d192d045 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:37.263388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f9da-2580-40d1-95e6-18e4d192d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:37.356183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-de63f9da-2580-40d1-95e6-18e4d192d045 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:37.357920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-de63f9da-2580-40d1-95e6-18e4d192d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:37.525297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:11:37.690866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:37.694025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:37.898541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017655-fbbe-4bd5-8b85-871661e46e08 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:37.907373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:37.908298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:37.908741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:37.909178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:37.924198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:37.927135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897bf50-659e-406d-b465-5c4317c39dbd service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:37.944715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 747/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:39.382303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d032ef-90f9-42af-abdb-0d66df89f618 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:39.383210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d032ef-90f9-42af-abdb-0d66df89f618 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:39.383210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d032ef-90f9-42af-abdb-0d66df89f618 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:39.385271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:39.393360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450339-967b-4416-a4ac-817e84bbd6ff None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:39.394017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450339-967b-4416-a4ac-817e84bbd6ff None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:39.394017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450339-967b-4416-a4ac-817e84bbd6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:39.417118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9c450339-967b-4416-a4ac-817e84bbd6ff None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:39.418450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9c450339-967b-4416-a4ac-817e84bbd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:39.426232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff160-76f9-43b6-87d9-ac00f65a0928 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:39.426841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff160-76f9-43b6-87d9-ac00f65a0928 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:39.427332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ff160-76f9-43b6-87d9-ac00f65a0928 None None] PATH_INFO: `/v3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:39.427873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:39.428926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 768/1516] 10.222.0.65 () {54 vars in 925 bytes} [Mon Sep 19 16:11:39 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:11:39.436143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d20b-f0e0-48c8-8188-7d46e2721a42 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:39.436445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d20b-f0e0-48c8-8188-7d46e2721a42 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:39.436706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d20b-f0e0-48c8-8188-7d46e2721a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:39.510026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c060d20b-f0e0-48c8-8188-7d46e2721a42 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:39.511296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c060d20b-f0e0-48c8-8188-7d46e2721a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:39.580597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:39.584244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ff160-76f9-43b6-87d9-ac00f65a0928 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:39.599971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ff160-76f9-43b6-87d9-ac00f65a0928 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:39.604234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 749/1517] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Sep 19 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:39.605908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:39.606541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:39.606825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:39.607095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:39.622897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:39.624690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d044d-59ba-4d60-bee1-5fcaf44b3507 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:39.635123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 769/1518] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:43.208197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b69f6-355a-4a6f-9696-816a1f052705 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:43.208772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b69f6-355a-4a6f-9696-816a1f052705 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:43.208872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b69f6-355a-4a6f-9696-816a1f052705 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:43.210160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 750/1519] 10.222.0.27 () {54 vars in 961 bytes} [Mon Sep 19 16:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:43.216010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e3f6-b794-420b-aad2-022db0e32fc5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:43.216743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e3f6-b794-420b-aad2-022db0e32fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:43.216743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e3f6-b794-420b-aad2-022db0e32fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:43.241336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-af92e3f6-b794-420b-aad2-022db0e32fc5 None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:43.245105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af92e3f6-b794-420b-aad2-022db0e32fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:43.255316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 770/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Sep 19 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:11:43.264550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b69f6-355a-4a6f-9696-816a1f052705 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:43.279125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b69f6-355a-4a6f-9696-816a1f052705 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:43.283908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:43.284494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:43.284769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:43.285036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:43.293069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:43.294741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f04381-aae9-48c5-ae20-c9838b860311 service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:43.304923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 751/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:51.139182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47365ca-6d80-4d66-adab-cc53364f330f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:51.139763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47365ca-6d80-4d66-adab-cc53364f330f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:51.139763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47365ca-6d80-4d66-adab-cc53364f330f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:51.141036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:51.147145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122bfd-d383-4606-94b6-ff6c89f10b82 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:51.147547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122bfd-d383-4606-94b6-ff6c89f10b82 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:51.147698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122bfd-d383-4606-94b6-ff6c89f10b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:51.167421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d8122bfd-d383-4606-94b6-ff6c89f10b82 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:51.168606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8122bfd-d383-4606-94b6-ff6c89f10b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:51.177038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:51.330846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47365ca-6d80-4d66-adab-cc53364f330f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:51.351304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47365ca-6d80-4d66-adab-cc53364f330f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:51.356759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:51.357359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:51.357635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:51.357907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:51.367195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:51.368894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc53cf8-ed38-4031-96ee-50f914174a5f service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:51.378430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 772/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:52.453604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ce22-2021-4080-97a0-bf014c1e907e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:52.454130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ce22-2021-4080-97a0-bf014c1e907e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:52.454234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ce22-2021-4080-97a0-bf014c1e907e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:52.455581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 16:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:52.461696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60dbc-c212-4be3-9b1d-56b2b3a52a68 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:52.462164 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60dbc-c212-4be3-9b1d-56b2b3a52a68 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:52.462266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60dbc-c212-4be3-9b1d-56b2b3a52a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:52.481753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7bd60dbc-c212-4be3-9b1d-56b2b3a52a68 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:52.482972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7bd60dbc-c212-4be3-9b1d-56b2b3a52a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:52.491271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 16:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:52.641706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ce22-2021-4080-97a0-bf014c1e907e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:52.655942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ce22-2021-4080-97a0-bf014c1e907e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:52.661285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:52.661898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:52.662174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:52.662444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:52.670955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:52.672561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba9ca2-82ed-48ab-9c9b-32c4fea17878 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:52.682443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 754/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:56.725119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:56.725647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:56.725647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:56.727044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:56.732218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6dbd-6779-4792-818a-67378b62a0c1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:56.732668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6dbd-6779-4792-818a-67378b62a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:56.732778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6dbd-6779-4792-818a-67378b62a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:56.752630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-17fe6dbd-6779-4792-818a-67378b62a0c1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:56.754354 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-17fe6dbd-6779-4792-818a-67378b62a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:56.762060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:57.044521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:57.046462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:57.081298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:11:57.125951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34b733-adad-4402-9b43-ad48d2cc3ed7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:57.130089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:57.130712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:57.130987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:57.131261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:57.140013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:57.141463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a97fc6-47bc-4ab0-83bd-62caccf53e2b service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:57.150742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 775/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:11:59.280961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:59.281504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:59.281504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:59.282893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:11:59.288848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac208c-e1da-4af5-892b-48a479ebc9f8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:59.289271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac208c-e1da-4af5-892b-48a479ebc9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:59.289419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac208c-e1da-4af5-892b-48a479ebc9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:59.311292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c3ac208c-e1da-4af5-892b-48a479ebc9f8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:11:59.312507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c3ac208c-e1da-4af5-892b-48a479ebc9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:59.322186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:11:59.617567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:11:59.619254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:11:59.631961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeba7c-7676-418c-9b5b-6fbfe80331b5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:11:59.635375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:11:59.635965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:11:59.636232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:11:59.636498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:11:59.645256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:11:59.646689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee4994-d1dd-4678-85f7-d10a3166002c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:11:59.655894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 757/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:12:03.585332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:03.585963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:03.585963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:03.587238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:12:03.592623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c4b4e-cd60-4f03-840c-bb87d99443b4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:03.593057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c4b4e-cd60-4f03-840c-bb87d99443b4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:03.593173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c4b4e-cd60-4f03-840c-bb87d99443b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:03.614408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ed0c4b4e-cd60-4f03-840c-bb87d99443b4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:12:03.615571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ed0c4b4e-cd60-4f03-840c-bb87d99443b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:12:03.623572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:12:03.939682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:12:03.942004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:12:04.019596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2186-2e66-44ec-9243-f8834bb774cc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:12:04.023157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:12:04.023759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:04.024037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:04.024309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:04.033156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:12:04.035142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9c728-9520-4877-a696-12dee6dd737d service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:12:04.044563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 778/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:12:06.189085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:06.189613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:06.189613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:06.191493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 16:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:12:06.196764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b9f3-a111-4dd8-9112-d632c05d5d54 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:06.197260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b9f3-a111-4dd8-9112-d632c05d5d54 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:06.197361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b9f3-a111-4dd8-9112-d632c05d5d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:06.216569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0320b9f3-a111-4dd8-9112-d632c05d5d54 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:12:06.217753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0320b9f3-a111-4dd8-9112-d632c05d5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:12:06.227426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 16:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:12:06.527302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:12:06.528982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:12:06.542197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e98dd-a96d-48dc-8256-28ffab5852c9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:12:06.546219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:12:06.546833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:12:06.547106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:12:06.547371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:12:06.556628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:12:06.558031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862d13a-4e08-44a5-a2c3-b543a62d63a0 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:12:06.567360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 760/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:12:16.211761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=63 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:12:16.563398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=37 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:34.645739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.647217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.647728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.680618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.682323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:34.694209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 780/1540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:13:34.703152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d513-ef79-472d-b048-b1074c3e69b4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.704787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d513-ef79-472d-b048-b1074c3e69b4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.705299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d513-ef79-472d-b048-b1074c3e69b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.738566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-86e8d513-ef79-472d-b048-b1074c3e69b4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.740392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-86e8d513-ef79-472d-b048-b1074c3e69b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:34.753646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 761/1541] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:34.758005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:34.773818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e083-c863-477e-b984-2bc164d2e40e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:34.779924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:34.780964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.781516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.782020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.782939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:34.783468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:34.785299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:34.803839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 781/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:34.811849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae04334-82af-4816-9c99-ae16748eaa67 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.813007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae04334-82af-4816-9c99-ae16748eaa67 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.813491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae04334-82af-4816-9c99-ae16748eaa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.822477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:34.840331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7ae04334-82af-4816-9c99-ae16748eaa67 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.841538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7ae04334-82af-4816-9c99-ae16748eaa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:34.844408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccbe2-9502-4fd6-9d19-fb0dd748dea1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:34.856598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:34.857558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.858065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.858589 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.858964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 762/1543] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:34.859694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:34.860248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0c93-c184-45c0-91c4-4a81710e21f3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.860539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0c93-c184-45c0-91c4-4a81710e21f3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.861003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a0c93-c184-45c0-91c4-4a81710e21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.862004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:34.862004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:13:34.862004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:13:34.863612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6636b-dc93-40c9-a0e8-1d0b150f12b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:34.890740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-205a0c93-c184-45c0-91c4-4a81710e21f3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.892615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-205a0c93-c184-45c0-91c4-4a81710e21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:34.910629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 763/1544] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:34.912122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53abd-d991-40ad-be3c-bd0463bf3137 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.912417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53abd-d991-40ad-be3c-bd0463bf3137 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.912696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe53abd-d991-40ad-be3c-bd0463bf3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.928331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 782/1545] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:34.929967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a334cf-12af-4c9f-83a9-1cca2288cdab None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:34.930501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a334cf-12af-4c9f-83a9-1cca2288cdab None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:34.930944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a334cf-12af-4c9f-83a9-1cca2288cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:34.945697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ebe53abd-d991-40ad-be3c-bd0463bf3137 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.946973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ebe53abd-d991-40ad-be3c-bd0463bf3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:34.967188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c5a334cf-12af-4c9f-83a9-1cca2288cdab None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:34.968667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c5a334cf-12af-4c9f-83a9-1cca2288cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.032255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 764/1546] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.033535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.033816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.034088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.058451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.059715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.061914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 783/1547] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.064482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006677bd-dd05-4084-9a25-a103d6c711af None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.064764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006677bd-dd05-4084-9a25-a103d6c711af None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.065030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006677bd-dd05-4084-9a25-a103d6c711af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.074636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 765/1548] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.074636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.083490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da2b4-00de-4498-ae93-af599b840f11 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.088476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.089150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.089566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.089843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.090476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.091521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:35.091521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:13:35.091521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:13:35.092008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-006677bd-dd05-4084-9a25-a103d6c711af None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.092719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca5dd6-9602-43ef-8599-f909d2d087b1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.093259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-006677bd-dd05-4084-9a25-a103d6c711af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.102735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 784/1549] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.107933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.108252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.108720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.119752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 766/1550] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/users => generated 291 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.119752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315101-e35f-4c9d-b3f0-ebed8db1f7a4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.119752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315101-e35f-4c9d-b3f0-ebed8db1f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.119752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315101-e35f-4c9d-b3f0-ebed8db1f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.131294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.132620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.138215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b3315101-e35f-4c9d-b3f0-ebed8db1f7a4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.139424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b3315101-e35f-4c9d-b3f0-ebed8db1f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.141661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 785/1551] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.142417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.154611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 767/1552] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.154611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fc24-5824-41aa-8da7-f986c077a634 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.154611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fc24-5824-41aa-8da7-f986c077a634 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.154611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fc24-5824-41aa-8da7-f986c077a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.155057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04f6b-8d04-4e40-96df-5a973fd47ede None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.157882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.158506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.158791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.159062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.159707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.160012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.161658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27063-6365-4b36-ad79-cc0d34d4fdf3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.170022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cd97fc24-5824-41aa-8da7-f986c077a634 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.171229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cd97fc24-5824-41aa-8da7-f986c077a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.175240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 786/1553] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.176437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.176721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.176998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.179737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 768/1554] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.180867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.181151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.181425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.201714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.203158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.204002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.205079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.211138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 769/1555] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.211897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.213052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 787/1556] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.213732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.223007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf33fe-58b7-4dbe-a692-6a34457d4423 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.224657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22bb48-18fc-42bd-b6a2-7dad40553e6c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.227728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.228311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.228586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.228854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.229473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.229596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.230063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.230337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.230640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.231083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98ba4-11e2-48e9-b0f2-07841dfdd5db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.231276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.231571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.232572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:35.232572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:13:35.232572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:13:35.233439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f67249-ddf7-4523-b8d6-204b418ffa4f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.245086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 788/1557] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:35.245086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.245086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.245086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.253733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 770/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.253733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386267-4256-40e4-9ef4-c7fc3b17985d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.253733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386267-4256-40e4-9ef4-c7fc3b17985d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.253733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386267-4256-40e4-9ef4-c7fc3b17985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.266759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.267388 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2e386267-4256-40e4-9ef4-c7fc3b17985d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.267957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.268546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2e386267-4256-40e4-9ef4-c7fc3b17985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.275940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 789/1559] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.276867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 771/1560] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.277001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.281407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.281689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.281965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.287721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa87717-acec-4fa6-8dca-18090c5fb26d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.293254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.293846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.294387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.294689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.295306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.298509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.302938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:35.304135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:35.312119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 772/1561] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:35.313436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.322875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe037b9-0493-4653-85e5-9bf3611ffe30 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.327888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.328522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.328800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.329076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.329713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.330012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.331635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.335130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 790/1562] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.335130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.353233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 773/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.353233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.361555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd4987-67b0-46b7-9d60-8851f3b8c3da admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.377717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:35.400359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405593db-9db6-490a-839d-58b167b0bf27 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.405072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.405680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.405958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.406352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.406961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.407263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.408861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.413308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:35.420740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.421287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 791/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.421433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.421779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.422610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.422755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.423246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.424968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.432546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9c061-c9e8-42b9-91b6-dd1434ad36f4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.436418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 774/1565] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:35.436566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.440742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.441346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.441623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.442181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.442829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.444730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.447024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a9c2-655f-4cfd-8d48-eb48882c6108 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.451576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.452154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.452425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.452698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.453363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.453655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.455262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.467704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 775/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.468580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.476280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 792/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.476280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.486303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f7b-4611-4d2d-9c76-c778265074d1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.539960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb4d-acb6-4dc5-bd84-81b72f5de4dd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.543044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.543651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.544183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.544455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.545086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.545209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.545382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.545706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.545987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.546259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.547496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:35.547609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.547801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.549496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.559649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 776/1568] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.560438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.561402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 793/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:35.562168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.571939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752cf42-4962-49e1-8e6e-dc68be82e00a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.576549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.577139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.577371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760c3b9-ed49-4707-a6c0-e9bfd193aacf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.577517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.577699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.578401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.580335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.582047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.582685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.582966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.583234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.583855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.585794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.608820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 777/1570] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.613184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 794/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.613337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.613452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.622276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a17b0-4b5b-4644-9436-e2fc75049ead admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.675637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798577-8f48-4075-b200-380d6e641a3c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.679988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.680596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.680784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.680896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.681120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.681442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.681720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.681829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.681996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] PATH_INFO: `/v3/projects/faab45f5829d4639bf8f94c544bb230b/users/75146048e4d94b9b9b1d6ca731d8ee42/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.683680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.697122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faab45f5829d4639bf8f94c544bb230b, user_id=75146048e4d94b9b9b1d6ca731d8ee42, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.698195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:35.698195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:13:35.698195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:13:35.700180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.715026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 778/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.715588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 795/1573] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:35 2022] PUT /identity/v3/projects/faab45f5829d4639bf8f94c544bb230b/users/75146048e4d94b9b9b1d6ca731d8ee42/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:35.715701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.715808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.724519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:35.767620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:35.783207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ade0e-8bef-4d4d-9bb9-d73de8884dc7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.786446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0b8-0cef-4883-98b5-435ab1fa1181 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.787828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.788433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.788796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.789069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.789697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.791094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.791645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.791777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.791959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.792230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.792860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.795046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.813926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 796/1574] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.814896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.825555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 779/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.825555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.825838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaec7f2-ecbc-425c-83d4-58b7bda60d0d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.881232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42232454-e985-43b2-952b-071095874f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.881961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42232454-e985-43b2-952b-071095874f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.882139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42232454-e985-43b2-952b-071095874f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.882399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42232454-e985-43b2-952b-071095874f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.883045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42232454-e985-43b2-952b-071095874f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.885281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42232454-e985-43b2-952b-071095874f8a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.891854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061976ab-ef65-4c98-9f83-12db67e3ee3d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.896731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.897379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.897657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.898126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.898653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.900588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.914174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 797/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.918229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42232454-e985-43b2-952b-071095874f8a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.933397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 780/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:35.933397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:35.985443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42232454-e985-43b2-952b-071095874f8a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.990358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.990996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.991270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:35.991532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:35.992161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:35.993808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:35.994562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697832-e151-4ffb-9f76-4088669ef6cd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:35.999100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:35.999692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:35.999988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.000289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.000911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.002861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01c8f9-d788-41a6-bc90-74b87f830be3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.006762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 798/1578] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.006762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.014177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e34b-38b3-4540-bc30-ac014729e963 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.019898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.020493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.020767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.021029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.021644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.023584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.025990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 781/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:35 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.027120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.027407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.027683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.042444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.049368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 799/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.050362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.056773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] MFA Rules not processed for user `75146048e4d94b9b9b1d6ca731d8ee42`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:36.057982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:36.060416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190a72-af73-4d6d-a012-c8d0cbed94dd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.065156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.065744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.066029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.066303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.066977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.068573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.080525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 800/1581] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.083630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.091793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.095334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c6a3-bf71-4df6-bd03-ec38e783cedd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.100285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.100878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.101150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.101416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.102038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.103976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.126058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 801/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.127127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.129963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 782/1583] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:36.130811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.139299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a8ff-2816-4322-9e0b-4c62088b8f32 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.141641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998b40-4df0-4643-a502-5a7d38fd0a9f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.144880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.145474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.145754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.146029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.146689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.146804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.147312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.147724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.148005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.148630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.148804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.150569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.172191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 802/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.173081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.173517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 783/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.174445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.183108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc722d-be7d-4e3b-a7bf-c2c91ae3088c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.184430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990930b-27c6-4a40-9a39-b66d3d8cbe76 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.188287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.188870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.189147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.189414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.189650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.190040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.190232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.190524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.190798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.191425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.191664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.192988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.203823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 803/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.208811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 784/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.208811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.209054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.216736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8aeb5-8727-465b-835f-3db768c94f2e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.217208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c58f-07c5-4a15-af0a-c3f32e2a0ace admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.221380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.221862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.222015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.222214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.222433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.222588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.222796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.223073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.223181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.223697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.224707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.225246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.235146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 785/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.236375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.239424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 804/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.240273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.249014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb11cb-90b8-4fe8-811c-feba2d3202ae admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.250800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0852e50-ca91-4dc0-9ef4-f80f04f7f329 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.254255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.254880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.255290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.255547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.255670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.256126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.256238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.256400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.256665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.257273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.257755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.259291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.268499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 786/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.269295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.279521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca13f-acb3-403e-8758-4c0e8aaacee8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.284564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.285145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.285422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.285697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.286317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.287931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.288038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 805/1591] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.288769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.298817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 787/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.302431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.311916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c6da7-7869-4642-a9e5-d756f423ff03 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.354461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95016b0-c083-46ee-b23a-725a30c0944f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.359679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.360293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.360569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.360843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.361485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.363308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.373813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 806/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.374647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.384364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.385026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.385144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a5f23-ee3f-4249-9190-4fb5e5a19833 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.385300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.385570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] PATH_INFO: `/v3/projects/59235a45c11b404184d25c6bdc2add41/users/dd8269c9310d457ab007d0beec62f1b8/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.389625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.390214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.390529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.391400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.392032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.393622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.401014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59235a45c11b404184d25c6bdc2add41, user_id=dd8269c9310d457ab007d0beec62f1b8, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.403461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 807/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.403801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.404303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.413988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7d30c-af2d-4bcc-9a54-a852beb8c48f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.417394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 788/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/59235a45c11b404184d25c6bdc2add41/users/dd8269c9310d457ab007d0beec62f1b8/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.418208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.467893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.478430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.478737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.479427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.479706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.480161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] PATH_INFO: `/v3/projects/331102772f124e559c136a0e0b75fcf7/users/a11490d644a6482689eb26dd6fe965dd/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.490547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15964-8166-4578-a1ea-3d2642b3b2d3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.495067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331102772f124e559c136a0e0b75fcf7, user_id=a11490d644a6482689eb26dd6fe965dd, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.495888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.496549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.496821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.497087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.497706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.497824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.499337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.514189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 789/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.514189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.514503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 808/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/331102772f124e559c136a0e0b75fcf7/users/a11490d644a6482689eb26dd6fe965dd/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.514503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.523512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a567-ac3f-453e-b6c5-ce7fe6bca939 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.579629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5d529-c8c1-4c1a-b4be-c6c533da9848 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.581050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.581658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.581936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.582206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.582888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.584302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.584483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.584891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.585164 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.585431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.586243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.588165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.594602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 790/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.595406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.605916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d1187-9979-4005-92c8-e42084314190 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.610840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 809/1599] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:36.611732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.614465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.615172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.615527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.615805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.616433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.618074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.623313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d472c8-3f53-45a5-a09f-fab49063364f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.628665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.629278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 791/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.629519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.629873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.630040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.630275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.631067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.632837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a814c-46a3-4ad9-8568-6537422fd823 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.640550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1262-20bd-40e6-b65c-abcb8cc9759b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.647104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 810/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.647104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.647331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.647439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.647439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.647596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.647596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.647596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] PATH_INFO: `/v3/projects/26e69f01233d4df6844b937e771c9b52/users/6c49fa2c8e9347478e7e434efd0fb80f/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.662143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e69f01233d4df6844b937e771c9b52, user_id=6c49fa2c8e9347478e7e434efd0fb80f, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.664470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:36.665059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda95f-789a-44c4-8d7e-6b79496351a6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.665674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:36.675302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 811/1602] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:36.676099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.680150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 792/1603] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/26e69f01233d4df6844b937e771c9b52/users/6c49fa2c8e9347478e7e434efd0fb80f/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.681552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.681834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.682109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.686600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7210-8091-40b3-b3d5-79f667c828c6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.703104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:36.704299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:36.756504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.757160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.757434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.757946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] PATH_INFO: `/v3/projects/30df687287864e0796274e350e1ebb15/users/808db09850394908b136d607cd820327/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.766130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 793/1604] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:36.767141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.772302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30df687287864e0796274e350e1ebb15, user_id=808db09850394908b136d607cd820327, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.775193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.781208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4fad6-41e1-44bd-ad36-c903f37f8e48 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.786316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.787149 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.787429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.787703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] PATH_INFO: `/v3/projects/f7decb4400414bacb361b4eb4220dcbc/users/46c92e34135f4639a87b2e924158a37c/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.789883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 812/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/30df687287864e0796274e350e1ebb15/users/808db09850394908b136d607cd820327/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.790779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.803672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7decb4400414bacb361b4eb4220dcbc, user_id=46c92e34135f4639a87b2e924158a37c, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.806331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.830510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 794/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/f7decb4400414bacb361b4eb4220dcbc/users/46c92e34135f4639a87b2e924158a37c/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.830510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.832433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.855508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8007ea-3162-46e1-b550-ac7d6ed0a832 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.859192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:36.893889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f059-b1ca-4848-ae85-d6959b0a92be admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.898392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.899068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.899339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.899617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] PATH_INFO: `/v3/projects/3b23a287fede49b394b363c8efc8870c/users/aa7006ee52de44598022d4326747b427/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.914187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.914820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.914945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b23a287fede49b394b363c8efc8870c, user_id=aa7006ee52de44598022d4326747b427, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.915100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.915371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.916003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:36.917584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e6a4a-c37e-4895-8880-2f38b478a453 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.918263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:36.933019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 813/1607] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:36.933019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:36.936521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 795/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/3b23a287fede49b394b363c8efc8870c/users/aa7006ee52de44598022d4326747b427/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:36.940851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.940851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:36.940851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:36.941134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9df6c-2bd5-4f56-a06e-3ee738e19ee2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:36.958437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:36.959894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:36.998890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:36.999549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:36.999820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.000118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] PATH_INFO: `/v3/projects/d4bca7c007f4420781dad62a5590410e/users/6be676646a3542eba95013af0e37cd91/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.016416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bca7c007f4420781dad62a5590410e, user_id=6be676646a3542eba95013af0e37cd91, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.019240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.019500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 796/1609] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.022792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.034418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 814/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:36 2022] PUT /identity/v3/projects/d4bca7c007f4420781dad62a5590410e/users/6be676646a3542eba95013af0e37cd91/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:37.035460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.081667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce585e6-2111-4730-881e-71d466bd17f2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.092285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4dc18-bb0d-43d3-ba58-642ea9ff02e6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.096540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.097146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.097421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.097690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.107114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:37.135003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.135606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.135882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.136151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.154563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:37.161023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.162409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56502eeb-1f12-4ac7-b0e1-4662db1172c9 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.174392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 815/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:37.175661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.175945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.176220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.205296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] MFA Rules not processed for user `808db09850394908b136d607cd820327`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.206586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.206926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.208531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b2e6-65d2-483b-956b-f8fa9c1f1864 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.219654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 797/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:37.220897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913be13-a977-41b2-8b55-51db3b28512e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.221245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913be13-a977-41b2-8b55-51db3b28512e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.221586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913be13-a977-41b2-8b55-51db3b28512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.251315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e913be13-a977-41b2-8b55-51db3b28512e None None] MFA Rules not processed for user `46c92e34135f4639a87b2e924158a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.252557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e913be13-a977-41b2-8b55-51db3b28512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.276583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 816/1613] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.277662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.290515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e2f5-c4c2-4ae1-8e03-c34cb454b147 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.296489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.298115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.298517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.298905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] PATH_INFO: `/v3/projects/c5840952d1d64d6ebac0463f0d9b8644/users/13c8b70604e5402f87df7feec631b059/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.316694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5840952d1d64d6ebac0463f0d9b8644, user_id=13c8b70604e5402f87df7feec631b059, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.319752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.341653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 798/1614] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.341653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dcdf-05e2-4fef-a0b9-8603eedf8aa0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.341653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dcdf-05e2-4fef-a0b9-8603eedf8aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.341653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dcdf-05e2-4fef-a0b9-8603eedf8aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.352204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 817/1615] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:37 2022] PUT /identity/v3/projects/c5840952d1d64d6ebac0463f0d9b8644/users/13c8b70604e5402f87df7feec631b059/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:37.355522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.369100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1443dcdf-05e2-4fef-a0b9-8603eedf8aa0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.370831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1443dcdf-05e2-4fef-a0b9-8603eedf8aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.426042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb68d-3c8c-4e12-a0ee-9418795579bd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.430624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.431290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.431567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.431836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.445391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 799/1616] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.446802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.447088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.447341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.467388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:37.468624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.470860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.480332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 800/1617] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.481033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.493569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc522de-123e-4592-a175-2034dbd664d1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.499172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.500025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.500334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.500630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.501291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.503326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea1ec8-6d9a-425f-bacc-195f1d019131 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.518852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.520372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.536774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 818/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:37.536774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.541670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 801/1619] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:37.541670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880963d-48b8-4231-923b-28537a39112c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.541670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880963d-48b8-4231-923b-28537a39112c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.541670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880963d-48b8-4231-923b-28537a39112c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.546131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 802/1620] 10.222.0.27 () {54 vars in 965 bytes} [Mon Sep 19 16:13:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:13:37.546834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880963d-48b8-4231-923b-28537a39112c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.557176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048451-b080-4cb2-9f48-d65735b93fd6 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.571495 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:37.638679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880963d-48b8-4231-923b-28537a39112c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.644425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.645549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.646148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.646643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.648842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.649643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.650027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.650302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.651306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.653200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.661036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.662852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.667336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 819/1621] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:37.668520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.682844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 803/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:37.683274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8168ec-ab22-43d6-8fd1-8316921563d6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.684057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.689550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.690228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.690742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.691069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.696817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cf110-ea30-42a0-9dfd-c38dacf2a18c service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.703597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.704325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.704450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.704861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.705176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.705891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7c26f-8092-4936-9b2e-5816e0b43a2e service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.706009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.708316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.717602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 820/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:37.719640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64077997-f4fc-4e74-8137-315e887b66af None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.719970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64077997-f4fc-4e74-8137-315e887b66af None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.720299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64077997-f4fc-4e74-8137-315e887b66af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.746311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 804/1624] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/users => generated 303 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:37.747633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.761039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84a68-acff-4d73-ad3e-965c4c159b9e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.768478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.769181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.769425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.769895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] PATH_INFO: `/v3/projects/c5840952d1d64d6ebac0463f0d9b8644/users/13c8b70604e5402f87df7feec631b059/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.772131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5840952d1d64d6ebac0463f0d9b8644, user_id=13c8b70604e5402f87df7feec631b059, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.775901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.780596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-64077997-f4fc-4e74-8137-315e887b66af None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.782736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64077997-f4fc-4e74-8137-315e887b66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.792034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 805/1625] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:37 2022] PUT /identity/v3/projects/c5840952d1d64d6ebac0463f0d9b8644/users/13c8b70604e5402f87df7feec631b059/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:37.792939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:37.892107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2029c-c9a9-4855-bbc4-395c775e1e6f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:37.898722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:37.899514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.899983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.900395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.901171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:37.903490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350585-9b3a-4cfb-a52e-058ba06edec0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:37.921970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 806/1626] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:37.924457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:37.924885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:37.925192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:37.978700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] MFA Rules not processed for user `13c8b70604e5402f87df7feec631b059`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:37.980126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:37.992285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 821/1627] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:37.993902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64077997-f4fc-4e74-8137-315e887b66af None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.010749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64077997-f4fc-4e74-8137-315e887b66af None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.024151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.025242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.025623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.025998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] PATH_INFO: `/v3/projects/7f8fee9f92ba411c8ed87537de24483c/users/680bb83b93ca4feb9b6edeb0b7d6e72c/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.044584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8fee9f92ba411c8ed87537de24483c, user_id=680bb83b93ca4feb9b6edeb0b7d6e72c, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.049256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.081840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:38.095086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 822/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:37 2022] PUT /identity/v3/projects/7f8fee9f92ba411c8ed87537de24483c/users/680bb83b93ca4feb9b6edeb0b7d6e72c/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:38.095086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.115874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 807/1629] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:38.116808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.132248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185691f5-620f-42a5-845a-efe22c3ff20b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.147463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:38.234084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e839a-7ba5-4442-8012-9e4dc7ba5b38 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.235168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.236441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.236722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.236992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.238907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.240928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.243569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.244571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.245059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.245716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.256653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 808/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:38.257668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.353462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.365447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.379954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 823/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:38.381062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.392333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa630e-0d00-4629-b7eb-4f6c7532f1f7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.395854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.396464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.396744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.397016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.401264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564f09-4b05-438d-a49f-7788981a7ac3 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.408777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.410255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.410645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.410988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] PATH_INFO: `/v3/projects/7f8fee9f92ba411c8ed87537de24483c/users/680bb83b93ca4feb9b6edeb0b7d6e72c/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.413283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8fee9f92ba411c8ed87537de24483c, user_id=680bb83b93ca4feb9b6edeb0b7d6e72c, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.416711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23d8fb-c41d-47cb-afc3-dd11c24c58d5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.432783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 824/1632] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:38 2022] PUT /identity/v3/projects/7f8fee9f92ba411c8ed87537de24483c/users/680bb83b93ca4feb9b6edeb0b7d6e72c/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:38.444419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.445230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.445758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.490188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.490558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.502644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 809/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:38.519388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] MFA Rules not processed for user `680bb83b93ca4feb9b6edeb0b7d6e72c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:38.520717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:38.644851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 825/1634] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:38.656907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.660881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:38.667859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee8e5-a80a-49ce-a6fc-adf5f7067646 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.679115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:38.792354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a71cc-e041-402a-a546-c10a87be9227 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:38.796684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.798656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:38.799365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.799725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.800113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.800956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.801393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.801635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.826614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.828700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e3d1d-65d7-4e02-9ad1-ae59645749a2 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.847537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:38.860831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 810/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:38.862420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485a53-6143-42e9-b84f-3fc278725de0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.862731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485a53-6143-42e9-b84f-3fc278725de0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.863005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485a53-6143-42e9-b84f-3fc278725de0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.865752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 811/1636] 10.222.0.27 () {54 vars in 912 bytes} [Mon Sep 19 16:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:13:38.870513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:38.870801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:38.871074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:38.882973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:38.884705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:38.910862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 826/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:38.919144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:38.920377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:39.000854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:39.010540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54524-931f-4f53-9b05-50f324dcfcf4 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:39.027352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:39.028953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:39.035090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:39.035575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:39.096729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 812/1638] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:13:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:13:39.189185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:39.191203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb066a-48d2-4ff2-8b08-5c063e3a0858 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:39.213822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 827/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:39.393596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:39.415240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39c3c-b3bf-4301-bd05-774cce602f63 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:39.425090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:39.428085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:39.428470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:39.429027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:39.454977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:39.459740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588a00-bb9c-4e50-bd7c-4843ae42f8a1 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:39.486235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 813/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:40.882270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b7f01-1c14-4415-815d-43595f949fa5 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:40.883307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b7f01-1c14-4415-815d-43595f949fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:40.883765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b7f01-1c14-4415-815d-43595f949fa5 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:40.885339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 828/1641] 10.222.0.27 () {54 vars in 965 bytes} [Mon Sep 19 16:13:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:13:40.915624 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9beb9-69b8-4412-9f08-9647a4e15941 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:40.916152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9beb9-69b8-4412-9f08-9647a4e15941 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:40.916263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9beb9-69b8-4412-9f08-9647a4e15941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:40.955786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c6b9beb9-69b8-4412-9f08-9647a4e15941 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:40.957151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c6b9beb9-69b8-4412-9f08-9647a4e15941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:40.977945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 814/1642] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Sep 19 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:40.987697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e211-be30-419e-9dfc-dba6cd5d632c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:40.987697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e211-be30-419e-9dfc-dba6cd5d632c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:40.988125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e211-be30-419e-9dfc-dba6cd5d632c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:40.989796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 829/1643] 10.222.0.27 () {54 vars in 912 bytes} [Mon Sep 19 16:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:13:41.003420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:41.003737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:41.003976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:41.055791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:41.057057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:41.080468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 815/1644] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:13:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:41.111661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e211-be30-419e-9dfc-dba6cd5d632c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:41.125818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e211-be30-419e-9dfc-dba6cd5d632c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:41.136681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:41.137393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:41.137576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:41.137891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:41.174392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:41.179145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ff05a-3605-4c54-9a16-b7bd32dde999 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:41.215893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 830/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:13:44.856781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:45.021912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55132c-af56-4247-b6f3-c7d30ca4c2cf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:45.027504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:45.028176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:45.028961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:45.029239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] PATH_INFO: `/v3/users/808db09850394908b136d607cd820327` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:45.031656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=808db09850394908b136d607cd820327)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:45.034057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:45.149935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808db09850394908b136d607cd820327'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:45.171458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808db09850394908b136d607cd820327'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:45.172137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808db09850394908b136d607cd820327'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:45.172744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808db09850394908b136d607cd820327'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:45.190942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808db09850394908b136d607cd820327'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:45.213565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:45.246787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 816/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:44 2022] DELETE /identity/v3/users/808db09850394908b136d607cd820327 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:45.251845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:45.252405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:45.252405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:45.299143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:45.303231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:45.434461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:45.496297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 831/1647] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:45.545346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:45.547365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:45.658302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679d31-3fa1-4ff3-801d-4d92241092cb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:45.665562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:45.668242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:45.669042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:45.669711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:45.690047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:45.694978 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25eaff-20b5-41f8-a787-b275bf306952 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:45.717648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 817/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:46.085272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:46.087598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:46.114849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd02b8-671a-4b09-9fb5-731725745af8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:46.127765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:46.128811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:46.129475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:46.129755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] PATH_INFO: `/v3/users/46c92e34135f4639a87b2e924158a37c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:46.131916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c92e34135f4639a87b2e924158a37c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:46.132985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:46.132985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: warnings.warn(msg) Sep 19 16:13:46.132985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: Sep 19 16:13:46.136582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:46.298315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c92e34135f4639a87b2e924158a37c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:46.319047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c92e34135f4639a87b2e924158a37c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:46.319886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c92e34135f4639a87b2e924158a37c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:46.320667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c92e34135f4639a87b2e924158a37c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:46.348712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c92e34135f4639a87b2e924158a37c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:46.439765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 832/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:46 2022] DELETE /identity/v3/users/46c92e34135f4639a87b2e924158a37c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:13:46.441408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:46.441866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:46.442335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:46.497691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:46.505553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:46.676016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 818/1650] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:46.743875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:46.749510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:47.028058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4881e3-8f2d-46ce-8738-2a782059be8e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:47.042371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:47.045017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:47.055051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:47.055776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:47.085979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:47.090128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:47.126219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 833/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:48.139349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:48.141456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:48.167088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947510b0-5763-4d3d-8de6-c6db1f588771 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:48.188472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:48.189526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:48.190036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:48.190518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] PATH_INFO: `/v3/projects/f7decb4400414bacb361b4eb4220dcbc` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:48.191998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7decb4400414bacb361b4eb4220dcbc)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:48.193334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 16:13:48.193334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: warnings.warn(msg) Sep 19 16:13:48.193334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: Sep 19 16:13:48.197915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:48.479898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7decb4400414bacb361b4eb4220dcbc', 'request_id': 'req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:48.518295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7decb4400414bacb361b4eb4220dcbc', 'request_id': 'req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:48.537828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7decb4400414bacb361b4eb4220dcbc', 'request_id': 'req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:48.615966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:48.619337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:48.630218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] The token cache is being invalidate because project f7decb4400414bacb361b4eb4220dcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:13:48.630770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:48.647140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ed38d6f8-8f32-4ab0-813e-6dd0e3ee8d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:48.657644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 819/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:13:48 2022] DELETE /identity/v3/projects/f7decb4400414bacb361b4eb4220dcbc => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:48.657805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ab50-1826-444b-bac0-ec1d6089a06c service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:48.659537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:48.659898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:48.660231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:48.720766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:48.724737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:48.743326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:48.892980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:48.896967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:48.897392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:48.899249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] PATH_INFO: `/v3/projects/30df687287864e0796274e350e1ebb15` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:48.907502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30df687287864e0796274e350e1ebb15)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:48.917989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:48.924695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 820/1653] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:48.925829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:48.927737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:48.945337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:48.986791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54000-9f41-4798-8b97-a067abd2e75d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.007395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:49.007395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.007395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.007395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] PATH_INFO: `/v3/users/75146048e4d94b9b9b1d6ca731d8ee42` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.009858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75146048e4d94b9b9b1d6ca731d8ee42)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:49.013008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:49.121005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30df687287864e0796274e350e1ebb15', 'request_id': 'req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.141204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75146048e4d94b9b9b1d6ca731d8ee42'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.141943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30df687287864e0796274e350e1ebb15', 'request_id': 'req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.154125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30df687287864e0796274e350e1ebb15', 'request_id': 'req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.168325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75146048e4d94b9b9b1d6ca731d8ee42'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.169383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75146048e4d94b9b9b1d6ca731d8ee42'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.170005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75146048e4d94b9b9b1d6ca731d8ee42'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.189952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75146048e4d94b9b9b1d6ca731d8ee42'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.195141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] The token cache is being invalidate because project 30df687287864e0796274e350e1ebb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:13:49.195704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.198128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4f4f4f09-62cf-4feb-bb12-391f9ec71f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.207127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 834/1654] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:13:48 2022] DELETE /identity/v3/projects/30df687287864e0796274e350e1ebb15 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:49.207127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11baccb-1143-4b49-a812-9bdbccf6bcce None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.208024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11baccb-1143-4b49-a812-9bdbccf6bcce None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.208306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11baccb-1143-4b49-a812-9bdbccf6bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.254942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 821/1655] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:48 2022] DELETE /identity/v3/users/75146048e4d94b9b9b1d6ca731d8ee42 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:49.259281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:49.262527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:49.276087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a11baccb-1143-4b49-a812-9bdbccf6bcce None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:49.276801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a11baccb-1143-4b49-a812-9bdbccf6bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:49.456812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a659df-91e0-4731-9099-3b46905da6c9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.466794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 835/1656] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:49.472806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.473865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.475080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.482932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:49.484432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.485652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.486907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] PATH_INFO: `/v3/users/680bb83b93ca4feb9b6edeb0b7d6e72c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.492261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680bb83b93ca4feb9b6edeb0b7d6e72c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:49.496605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:49.523092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:49.528015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:49.550261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 836/1657] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:49.556628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:49.568380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:49.584186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9d1c-5415-4d6f-bd23-0968c5b52e18 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.596037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:49.596775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.597155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.597555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.598310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:49.599400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:49.608063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:49.613957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680bb83b93ca4feb9b6edeb0b7d6e72c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.629931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680bb83b93ca4feb9b6edeb0b7d6e72c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.630793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680bb83b93ca4feb9b6edeb0b7d6e72c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.631621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680bb83b93ca4feb9b6edeb0b7d6e72c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.641224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 837/1658] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:49.642583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:49.648744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:49.651433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680bb83b93ca4feb9b6edeb0b7d6e72c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:49.683519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ad49-9ee4-4f6b-8efb-6cf018acf3f7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.703355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 822/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:49 2022] DELETE /identity/v3/users/680bb83b93ca4feb9b6edeb0b7d6e72c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:49.703632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:49.704449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.705279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:49.705655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.706037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.707163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:49.711256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:49.731060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:49.799248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 838/1660] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:49 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:49.800566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:49.873312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256425-8d45-4d95-8846-ea99a0a796f4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.960956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:49.981897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4b319-7573-4f81-97cf-af84eae2e35c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:49.996119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:49.996762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:49.997049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:49.997931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:49.998779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.009826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.044238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:50.055059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.055573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.056372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.066829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 839/1661] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:49 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:50.068025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:50.069208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:50.103468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57f83-dce1-49b6-8a1d-6bcf7622a07a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:50.114741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.114959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:50.116320 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.116812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.117295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.118657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.119816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.121576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.157171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 823/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:50.160149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 840/1663] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:50.165030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:50.192285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96485-6c18-428c-b68e-82b9b131d03b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:50.203356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:50.203991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.204266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.204535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.205457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.207125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa357c-7dc1-4b99-967f-2678f286e33f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.243702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 824/1664] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:50.248176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:50.275636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9372-1dfc-459d-8616-7634393a98de admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:50.287218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:50.289623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.290010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.291393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] PATH_INFO: `/v3/projects/081d155b754c4a2ca167a3a707c333bc/users/0bde2ad8b2e44d2a9c3e843909b528cd/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.326596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=081d155b754c4a2ca167a3a707c333bc, user_id=0bde2ad8b2e44d2a9c3e843909b528cd, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.330879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.376375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 841/1665] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:50 2022] PUT /identity/v3/projects/081d155b754c4a2ca167a3a707c333bc/users/0bde2ad8b2e44d2a9c3e843909b528cd/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:50.379560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.379976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.380863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.425029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] MFA Rules not processed for user `0bde2ad8b2e44d2a9c3e843909b528cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:50.427528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:50.497954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:50.560856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 825/1666] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:50.565681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:50.766848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23938f2b-e87a-49f0-87a7-5b20baffee6b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:50.783217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:50.784271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:50.784623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:50.784958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:50.786339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:50.793147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:50.894150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 842/1667] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:50 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:50.895872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:50.914807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3e6a8-f462-4731-99c7-049bd94fe567 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.086414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.087143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.087427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.087698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.088555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.097384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.148341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 826/1668] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:50 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:51.152537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.166961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52604-797f-4c0f-b8ed-cad2730c3d86 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.187743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.188380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.188657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.188929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.189625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.200781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.241664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 843/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:51.243539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.264658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524b8c-4b9e-4464-887d-694121d71d81 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.282445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.283856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.284461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.285020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] PATH_INFO: `/v3/projects/721134b184ff4e9d92a485fd43e1a219/users/18ac277acbc74546bc32a93e63301ad9/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.312871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] RBAC: Authorizing `identity:create_grant(project_id=721134b184ff4e9d92a485fd43e1a219, user_id=18ac277acbc74546bc32a93e63301ad9, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.317819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.367488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 827/1670] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:51 2022] PUT /identity/v3/projects/721134b184ff4e9d92a485fd43e1a219/users/18ac277acbc74546bc32a93e63301ad9/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:51.371310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.383550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c96822-2a04-490b-994c-2ae6798b215f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.469550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.472331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.472670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.472999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.474193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.476436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67527a90-c6b8-4b4e-8463-265eac7f5448 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.494536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 844/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:51.497508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.510603 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22904c-dacd-4741-b4fc-2dfcc64f234b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.531797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.532582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.532935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.533280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] PATH_INFO: `/v3/projects/721134b184ff4e9d92a485fd43e1a219/users/18ac277acbc74546bc32a93e63301ad9/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.539404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=721134b184ff4e9d92a485fd43e1a219, user_id=18ac277acbc74546bc32a93e63301ad9, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.548490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.573049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 828/1672] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:51 2022] PUT /identity/v3/projects/721134b184ff4e9d92a485fd43e1a219/users/18ac277acbc74546bc32a93e63301ad9/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:51.588807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.589442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.590468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.708599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] MFA Rules not processed for user `18ac277acbc74546bc32a93e63301ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:51.711209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:51.742263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.744081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:51.753619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:51.912105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 845/1673] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:51.916942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee19d0-c9f3-456e-9677-8f967944d20e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:51.932536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:51.933194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:51.933471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:51.933750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] PATH_INFO: `/v3/projects/7f8fee9f92ba411c8ed87537de24483c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:51.935759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8fee9f92ba411c8ed87537de24483c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:51.938443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:51.943128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:51.945703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.038939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:52.074274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8fee9f92ba411c8ed87537de24483c', 'request_id': 'req-fdd18ab9-227d-4566-bd6d-1215132404b9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:52.090478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a699d5-33c9-42e4-a7f5-4e37973b6445 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:52.091547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8fee9f92ba411c8ed87537de24483c', 'request_id': 'req-fdd18ab9-227d-4566-bd6d-1215132404b9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:52.107077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8fee9f92ba411c8ed87537de24483c', 'request_id': 'req-fdd18ab9-227d-4566-bd6d-1215132404b9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:52.175857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] The token cache is being invalidate because project 7f8fee9f92ba411c8ed87537de24483c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:13:52.179948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:52.183061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fdd18ab9-227d-4566-bd6d-1215132404b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:52.187492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 829/1674] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:13:51 2022] DELETE /identity/v3/projects/7f8fee9f92ba411c8ed87537de24483c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:52.192975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6352a6-ea04-4c9b-a5a0-7b91474b4e86 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.193994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6352a6-ea04-4c9b-a5a0-7b91474b4e86 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.195404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6352a6-ea04-4c9b-a5a0-7b91474b4e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.257636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8e6352a6-ea04-4c9b-a5a0-7b91474b4e86 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:52.262757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8e6352a6-ea04-4c9b-a5a0-7b91474b4e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.320267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:52.323033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.328503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.329799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.346997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.530666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 830/1675] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:52.532984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.534115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.534553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.552369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:52.554383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d44bc-43e6-4dca-9952-ac2b2c02a8e8 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:52.579265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] MFA Rules not processed for user `aa7006ee52de44598022d4326747b427`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:52.581883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.591464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 846/1676] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:52.593262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.601263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.601714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.684355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:52.687707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.730865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 847/1677] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:52.731901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:52.748718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:52.766588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae448-5909-4efa-a369-6d7e98189fbd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:52.784912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:52.785723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.786002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.786273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.787100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:52.787404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:52.789022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:52.837165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 848/1678] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:52.838196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:52.847387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 831/1679] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:52.848473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:52.848738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.868483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da215c0-37d2-44e0-9ddb-70ecc7f857fe None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:52.876912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:52.877816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.878102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.878453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.879785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:52.881960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:52.893152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0fc86-c12b-4739-a8bb-754f3b5429ea admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:52.911518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:52.912434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:52.912434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:52.912434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:52.920403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:52.946729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 832/1680] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:52 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:52.949109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:52.953174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:53.033282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:53.087327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.091552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.133295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00ce97-727a-4650-b68d-c264cae81757 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.141035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.142001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.142599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.143207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.143527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 849/1681] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:53.144513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.174576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061fa7-3db7-4f8d-b5bc-e5fc62a99bb5 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.267838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.269474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.304564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 833/1682] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:53.372560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.372560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.372895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.372987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.373590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.375620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.418544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 850/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:53 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:53.420644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.439891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.441968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:53.453986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4054b47-1541-461f-8420-aa65e07aac3a service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.475599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab419f-b159-472c-99d8-2a6a31b4543f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.480566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.480681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.480903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.481182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.485851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.490053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.502341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.504134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.504134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.504134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] PATH_INFO: `/v3/projects/faab45f5829d4639bf8f94c544bb230b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.507539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faab45f5829d4639bf8f94c544bb230b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.509510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.546612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 834/1684] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:53.547867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.583935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab724-b929-48ef-89e7-48b44101d4e1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.605799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.616625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.616951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.617183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.619924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:53.627417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:53.691035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 835/1685] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:53.696470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.734417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b484b-4cd5-424d-b730-d90fa3742ec3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:53.737791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faab45f5829d4639bf8f94c544bb230b', 'request_id': 'req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:53.760094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faab45f5829d4639bf8f94c544bb230b', 'request_id': 'req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:53.779858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faab45f5829d4639bf8f94c544bb230b', 'request_id': 'req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:53.824524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:53.831182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] The token cache is being invalidate because project faab45f5829d4639bf8f94c544bb230b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:13:53.831776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:53.834191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:53.841651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 851/1686] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:13:53 2022] DELETE /identity/v3/projects/faab45f5829d4639bf8f94c544bb230b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:53.844021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:53.848432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:53.951436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:53.952362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:53.952554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:53.952821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] PATH_INFO: `/v3/projects/c509e3eb69174b13b8a5d98f8ccf5180/users/043609ee9ffc4c8184f955bee3ef4781/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:53.995025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c509e3eb69174b13b8a5d98f8ccf5180, user_id=043609ee9ffc4c8184f955bee3ef4781, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:54.000682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ccce4-f7c0-4773-8705-48ca636d9be0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:54.046920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 836/1687] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:53 2022] PUT /identity/v3/projects/c509e3eb69174b13b8a5d98f8ccf5180/users/043609ee9ffc4c8184f955bee3ef4781/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:54.048559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:54.048832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:54.049104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:54.064065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a56-6675-4b72-9bb1-e2bf8c607a40 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:54.163102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] MFA Rules not processed for user `043609ee9ffc4c8184f955bee3ef4781`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:54.165152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:54.217429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:54.218703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:54.219612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:54.220043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] PATH_INFO: `/v3/users/13c8b70604e5402f87df7feec631b059` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:54.221692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c8b70604e5402f87df7feec631b059)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:54.223731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:54.232647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:54.347179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c8b70604e5402f87df7feec631b059'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:54.365326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c8b70604e5402f87df7feec631b059'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:54.366630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c8b70604e5402f87df7feec631b059'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:54.367473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c8b70604e5402f87df7feec631b059'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:54.382002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c8b70604e5402f87df7feec631b059'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:54.426819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 837/1688] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:54.431330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:54.438833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 852/1689] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:53 2022] DELETE /identity/v3/users/13c8b70604e5402f87df7feec631b059 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:54.441874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:54.475094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccfec2-ab16-4cc6-8367-94b3403133e9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:54.672282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:54.672979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:54.673522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:54.673851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:54.674527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:54.676556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:54.744522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 838/1690] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:54 2022] POST /identity/v3/projects => generated 409 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:13:54.746354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:54.761484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d639-5db8-4ed7-ba67-f844d2836bbd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:54.830059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:54.894834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:54.895705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:54.896059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:54.896405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:54.897717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:54.900848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:54.942217 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 853/1691] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:54 2022] POST /identity/v3/users => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:54.945905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:54.962850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fbab-dd04-48a5-8d09-a3752d0c5b2f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:54.980797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:54.982047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:54.982342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:54.982661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:54.984082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:54.985741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:55.011756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 839/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:55.016649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:55.034970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d63a9-2385-43f8-a0bf-42f927754209 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:55.049362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:55.050055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.050334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.050640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] PATH_INFO: `/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3/users/85ba4468156145a88ad361547a850e4a/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.122366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7c5a27060d43ee9f3f2a52ddf0def3, user_id=85ba4468156145a88ad361547a850e4a, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:55.125890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86cd8-d727-4c1f-a91d-121d496b107e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:55.167421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 854/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:55 2022] PUT /identity/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3/users/85ba4468156145a88ad361547a850e4a/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:55.173264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:55.190527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d30f-29fb-4ef7-9ab6-f09706b09004 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:55.256215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611e0b5-dbde-49c0-99cf-ed7793269a97 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.256574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611e0b5-dbde-49c0-99cf-ed7793269a97 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.256826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611e0b5-dbde-49c0-99cf-ed7793269a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.334657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2611e0b5-dbde-49c0-99cf-ed7793269a97 None None] MFA Rules not processed for user `6be676646a3542eba95013af0e37cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:55.338513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2611e0b5-dbde-49c0-99cf-ed7793269a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:55.386296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:55.387197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.387613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.388037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.388825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:55.391136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:55.404730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 840/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:55.409703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:55.445297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc362-21d9-4af3-9a5c-4fc9225b916b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:55.455239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 855/1695] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:55.461944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.462557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.463802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.471927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:55.474050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.474711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.475129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] PATH_INFO: `/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3/users/85ba4468156145a88ad361547a850e4a/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.479078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7c5a27060d43ee9f3f2a52ddf0def3, user_id=85ba4468156145a88ad361547a850e4a, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:55.487775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805bb6-a992-41d2-9483-84f1b4f9187d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:55.524445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] MFA Rules not processed for user `6be676646a3542eba95013af0e37cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:55.526351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:55.529402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 841/1696] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:55 2022] PUT /identity/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3/users/85ba4468156145a88ad361547a850e4a/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:13:55.539972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:55.540570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:55.541049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:55.686079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] MFA Rules not processed for user `85ba4468156145a88ad361547a850e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:55.688275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:55.696178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:55.743131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 856/1697] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:55.754714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:55.758458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:55.839251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:55.904887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 842/1698] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:55.922844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:55.925217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:55.982140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fbb2-a91f-42d0-a4af-655b07fc12d0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:56.010408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:56.011070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:56.011346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:56.011616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:56.034691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:56.036309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:56.058727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 857/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:56.109249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5459-e7ff-4f78-af82-311ed6c749e4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:56.114734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:56.115424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:56.115723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:56.115994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:56.171711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:56.178900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:56.239075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 843/1700] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:13:56.621266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:56.635061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537a32-37d3-409f-97d0-1d2b9fa808cc service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:56.661372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:56.662003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:56.662518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:56.662686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:56.778638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:56.780806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:56.851395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:56.853291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e5d3f-9376-47ed-b09c-5d71cc468d81 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:56.881033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 858/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:56.938413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2b53-dcb3-40a4-8f9f-08bcf66b1ebb service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:56.944658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:56.945454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:56.945729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:56.946002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] PATH_INFO: `/v3/users/0bde2ad8b2e44d2a9c3e843909b528cd` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:56.947771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bde2ad8b2e44d2a9c3e843909b528cd)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:56.950522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:57.052661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:57.057384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bde2ad8b2e44d2a9c3e843909b528cd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:57.075917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bde2ad8b2e44d2a9c3e843909b528cd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:57.078285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bde2ad8b2e44d2a9c3e843909b528cd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:57.078964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bde2ad8b2e44d2a9c3e843909b528cd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:57.098367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bde2ad8b2e44d2a9c3e843909b528cd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:57.138855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 844/1702] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:13:56 2022] DELETE /identity/v3/users/0bde2ad8b2e44d2a9c3e843909b528cd => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:57.144199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2d35-bccc-47a5-b4fb-b582d12ee61f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.144566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2d35-bccc-47a5-b4fb-b582d12ee61f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.145470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2d35-bccc-47a5-b4fb-b582d12ee61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.197435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-68bc2d35-bccc-47a5-b4fb-b582d12ee61f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:57.199338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-68bc2d35-bccc-47a5-b4fb-b582d12ee61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:57.340159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 859/1703] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:57.425942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:57.427936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:57.474271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69809-a64d-4282-8442-e6b3131793f1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.474672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69809-a64d-4282-8442-e6b3131793f1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.475010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69809-a64d-4282-8442-e6b3131793f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.548054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-90d69809-a64d-4282-8442-e6b3131793f1 None None] MFA Rules not processed for user `dd8269c9310d457ab007d0beec62f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:57.549954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-90d69809-a64d-4282-8442-e6b3131793f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:57.708856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de5030-fee6-463f-a2ad-f3a3bf9edaf0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:57.714222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:57.715029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.715405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.715783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.725015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:57.741860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:57.744412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811aab-4446-477d-b996-5bf24bfc1c9c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:57.775648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 845/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:57.777650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b706d-6334-4cc9-bd57-d5bb020ddc91 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.779145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b706d-6334-4cc9-bd57-d5bb020ddc91 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.780349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b706d-6334-4cc9-bd57-d5bb020ddc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.785680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 860/1705] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:57.791530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.792181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.802095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.828857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 861/1706] 10.222.0.27 () {54 vars in 912 bytes} [Mon Sep 19 16:13:57 2022] GET /identity => generated 270 bytes in 42 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:13:57.831809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:57.837914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:57.889737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c1ad-78f1-40d1-bcc6-9b59c2cfcc7a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:57.895133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7a9b706d-6334-4cc9-bd57-d5bb020ddc91 None None] MFA Rules not processed for user `a11490d644a6482689eb26dd6fe965dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:57.899032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7a9b706d-6334-4cc9-bd57-d5bb020ddc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:57.901755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:57.902438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:57.902783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:57.903012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] PATH_INFO: `/v3/projects/c5840952d1d64d6ebac0463f0d9b8644` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:57.906514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5840952d1d64d6ebac0463f0d9b8644)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:57.911745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:58.036898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5840952d1d64d6ebac0463f0d9b8644', 'request_id': 'req-83994739-79d6-47e4-92b1-2a1797efd502'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:58.058647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5840952d1d64d6ebac0463f0d9b8644', 'request_id': 'req-83994739-79d6-47e4-92b1-2a1797efd502'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:58.070189 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5840952d1d64d6ebac0463f0d9b8644', 'request_id': 'req-83994739-79d6-47e4-92b1-2a1797efd502'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:58.103848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] The token cache is being invalidate because project c5840952d1d64d6ebac0463f0d9b8644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:13:58.104211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:58.105790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-83994739-79d6-47e4-92b1-2a1797efd502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:13:58.110245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 862/1707] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:13:57 2022] DELETE /identity/v3/projects/c5840952d1d64d6ebac0463f0d9b8644 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:58.112064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8a8d-6fea-48cd-8d09-9c850806008f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.112351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8a8d-6fea-48cd-8d09-9c850806008f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.112617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8a8d-6fea-48cd-8d09-9c850806008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.159613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a80d8a8d-6fea-48cd-8d09-9c850806008f None None] MFA Rules not processed for user `dd8269c9310d457ab007d0beec62f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:58.160887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a80d8a8d-6fea-48cd-8d09-9c850806008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.163138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 846/1708] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:58.170831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.171871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.172162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.304438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:58.306895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.378758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:58.388926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 863/1709] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:58.391241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.391555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.391905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.416742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 847/1710] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:58.418250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:58.421029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.477274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:58.480484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.623566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 864/1711] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:58.624647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:58.626008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.658373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018926b-3dcd-4b32-92ef-a3b77af97f02 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:58.676896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:58.677557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.677837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.678111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.681288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658710b4-d1ba-4b64-8dfe-13fb66473b0a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:58.693742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:58.702834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:58.704328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02523b44-8b60-4e3d-9a8f-94c12a370c95 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:58.705190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:58.708288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.710295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.710811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.728998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 865/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:58.730407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.730716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.730991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.779470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:58.780682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:58.799100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 866/1713] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:13:58.803719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:58.822093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c77b-5fb3-4175-b890-414a4e59177e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:58.837108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:58.838011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.838191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.838460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.839174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:13:58.839479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:58.841150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:58.878466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 867/1714] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:13:58.880298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:58.892190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:58.894237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:58.901186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291582-9d36-4b04-97ef-2d51d7241591 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:58.918920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:58.919556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:58.919835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:58.920109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:58.920779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:58.922858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:58.923945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 848/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:13:59.043452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 868/1716] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:13:58 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:13:59.048726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:59.082054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58fd4-4a42-4277-825a-08d92058e804 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:59.098640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:59.309905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:59.321420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.322110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.323415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.324711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:59.330075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:59.387705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 849/1717] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:13:59 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:13:59.389840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:59.394837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa841f-aa2c-4d33-8505-567476f03e64 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:59.410214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c0c3-aafd-4bae-af3b-a0ae1835160e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:59.434053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:59.434053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.434332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.445403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.446021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:59.456849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:59.466340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:59.467383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.468393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.471634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.485990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:13:59.488248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 850/1718] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:13:59.493524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:59.516625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5de7-f615-4cd0-b635-532826b63097 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:59.528392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:59.536491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.539039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.539310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.540013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:59.542401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:59.544240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:13:59.585438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 851/1719] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:13:59.591703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:13:59.620735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703b41-b847-47bd-9404-c54ac5667dbd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:13:59.627894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:13:59.629764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.630310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.630964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] PATH_INFO: `/v3/projects/451b2594c0344ddb8d16b1bcb04e691f/users/83ccc3b56e774807820c6534127bfe57/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.656360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451b2594c0344ddb8d16b1bcb04e691f, user_id=83ccc3b56e774807820c6534127bfe57, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:59.661715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b7b55-2c5e-4835-8e78-b2dc84695909 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:59.704537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:13:59.709009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:13:59.712823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 852/1720] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:13:59 2022] PUT /identity/v3/projects/451b2594c0344ddb8d16b1bcb04e691f/users/83ccc3b56e774807820c6534127bfe57/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:13:59.726294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:13:59.727422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:13:59.729090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:13:59.753534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 869/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:13:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:13:59.843116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] MFA Rules not processed for user `83ccc3b56e774807820c6534127bfe57`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:13:59.847250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:00.064749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 853/1722] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:00.069382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.081515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b907a-3543-4169-9946-c1c6b63696b9 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:00.164758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:00.180477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:00.181432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:00.181865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:00.182473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:00.183311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:00.185761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:00.281159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 870/1723] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:00 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:00.282204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.309716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02293f4f-198b-44dd-b48a-7e94e04491d1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:00.460057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:00.460839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:00.462620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:00.464556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:00.465385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:00.470677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:00.473879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.478535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:00.518922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35057b-e285-4cf0-a45b-abea453ca43f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:00.521159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 854/1724] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:00 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:00.525199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.535214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:00.536664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:00.536945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:00.537220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] PATH_INFO: `/v3/projects/081d155b754c4a2ca167a3a707c333bc` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:00.541387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081d155b754c4a2ca167a3a707c333bc)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:00.549045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f259c6f-91df-483f-adb0-5f32ad609ef8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:00.550404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:00.563519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:00.564345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:00.564725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:00.565094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:00.566545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:00.568282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:00.593961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 855/1725] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:00.596933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.628044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53076555-fa24-4014-9e23-9e3803b10a5e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:00.637466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:00.638314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:00.638719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:00.639277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] PATH_INFO: `/v3/projects/b8759675887d4a058b83ffaa4041ce61/users/7b71c9ddea5444829d6d798bceb85ccf/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:00.675576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8759675887d4a058b83ffaa4041ce61, user_id=7b71c9ddea5444829d6d798bceb85ccf, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:00.680476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:00.716982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 856/1726] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:00 2022] PUT /identity/v3/projects/b8759675887d4a058b83ffaa4041ce61/users/7b71c9ddea5444829d6d798bceb85ccf/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:00.724212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.791065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081d155b754c4a2ca167a3a707c333bc', 'request_id': 'req-559a581c-5d55-4287-bf73-d61aaafd9a03'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:00.792437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:00.821125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081d155b754c4a2ca167a3a707c333bc', 'request_id': 'req-559a581c-5d55-4287-bf73-d61aaafd9a03'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:00.848508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081d155b754c4a2ca167a3a707c333bc', 'request_id': 'req-559a581c-5d55-4287-bf73-d61aaafd9a03'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:00.895179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] The token cache is being invalidate because project 081d155b754c4a2ca167a3a707c333bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:00.899907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:00.902912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:00.908173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 871/1727] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:00 2022] DELETE /identity/v3/projects/081d155b754c4a2ca167a3a707c333bc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:00.914657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:00.923401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.003063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520fa0-0a42-4824-92aa-2787a3574c0f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:01.164990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:01.166327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.166785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.167228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.168020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:01.171716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a091-6557-4946-8452-af731aa2a5f3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:01.172308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a581c-5d55-4287-bf73-d61aaafd9a03 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:01.187331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:01.188341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.188730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.189433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] PATH_INFO: `/v3/users/18ac277acbc74546bc32a93e63301ad9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.190907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ac277acbc74546bc32a93e63301ad9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:01.193421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:01.198178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 857/1728] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:01.204589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.205931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.206427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.285067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] MFA Rules not processed for user `6c49fa2c8e9347478e7e434efd0fb80f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:01.289387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.302211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ac277acbc74546bc32a93e63301ad9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:01.323719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ac277acbc74546bc32a93e63301ad9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:01.324459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ac277acbc74546bc32a93e63301ad9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:01.325658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ac277acbc74546bc32a93e63301ad9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:01.337858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:01.343393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3dd32adb-fd1f-40af-a1b3-22884ed402ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ac277acbc74546bc32a93e63301ad9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:01.445473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 872/1729] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:00 2022] DELETE /identity/v3/users/18ac277acbc74546bc32a93e63301ad9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:01.445473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.445473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.445473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.455718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 873/1730] 10.222.0.27 () {54 vars in 912 bytes} [Mon Sep 19 16:14:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:14:01.456740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:01.463839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.552720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 858/1731] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:01.552720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:01.552720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.613894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883af11-67be-4bd8-b29e-12f068fce284 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:01.723138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175b6a-8151-4ad8-9fbc-5937155677c4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:01.753445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:01.754396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.754933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.755420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.763034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.776159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:01.787493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:01.789363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74f00-7929-4942-930c-aac392b0e0e0 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:01.809203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:01.810932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.815690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.817217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] PATH_INFO: `/v3/projects/b8759675887d4a058b83ffaa4041ce61/users/7b71c9ddea5444829d6d798bceb85ccf/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.821011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8759675887d4a058b83ffaa4041ce61, user_id=7b71c9ddea5444829d6d798bceb85ccf, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:01.826377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266580-1cac-434b-bac4-fc59bcc33d6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:01.827955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 874/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:01.828934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.829226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.829496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.846025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 859/1733] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:01 2022] PUT /identity/v3/projects/b8759675887d4a058b83ffaa4041ce61/users/7b71c9ddea5444829d6d798bceb85ccf/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:01.847861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b12a-f97d-49cb-bbd5-c4bfa0f20753 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:01.848359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b12a-f97d-49cb-bbd5-c4bfa0f20753 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:01.848984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b12a-f97d-49cb-bbd5-c4bfa0f20753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:01.871939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] MFA Rules not processed for user `aa7006ee52de44598022d4326747b427`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:01.873301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:01.911410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3a39b12a-f97d-49cb-bbd5-c4bfa0f20753 None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:01.916975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3a39b12a-f97d-49cb-bbd5-c4bfa0f20753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.023218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 875/1734] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:02.024250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:02.027054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.073115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 860/1735] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:02.074631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:02.074914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:02.075187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:02.131766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] MFA Rules not processed for user `7b71c9ddea5444829d6d798bceb85ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:02.134787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.182398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e63ce-e847-4ff5-a60e-71301dccee13 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:02.191839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:02.192626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:02.193004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:02.193371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:02.223495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:02.303855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 861/1736] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:02.304787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:02.316856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.344013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9fa9-dd1b-4586-b40c-bfe43a59ed43 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:02.347492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:02.351424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:02.361874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:02.362907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:02.363435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:02.363920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:02.374637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:02.376666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:02.387369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 876/1737] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:02.391178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 862/1738] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:02.391365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:02.392438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:02.394073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.395838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:02.510675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df52a2-c9eb-49f5-b78f-4f788ce884e8 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:02.515644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:02.516366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:02.516674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:02.516952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:02.538835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:02.540300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d2736-0908-4052-a09c-07c7605bd327 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:02.588981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 863/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:02.710964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d089c-bde6-4189-b186-efebbfbe753d service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:02.741940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:02.744836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:02.745330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:02.745763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] PATH_INFO: `/v3/projects/721134b184ff4e9d92a485fd43e1a219` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:02.749724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721134b184ff4e9d92a485fd43e1a219)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:02.756122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:03.026012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721134b184ff4e9d92a485fd43e1a219', 'request_id': 'req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.058863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721134b184ff4e9d92a485fd43e1a219', 'request_id': 'req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.066161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721134b184ff4e9d92a485fd43e1a219', 'request_id': 'req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.114726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] The token cache is being invalidate because project 721134b184ff4e9d92a485fd43e1a219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:03.115156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.117697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4ed5167d-8ec3-4185-80fb-f265b3e87fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.135732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 877/1740] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:02 2022] DELETE /identity/v3/projects/721134b184ff4e9d92a485fd43e1a219 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:03.137387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:03.137678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:03.137989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:03.161775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:03.182996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:03.188394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:03.391834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 864/1741] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:03.400266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:03.400817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:03.401325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:03.460565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:03.462991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:03.540069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 878/1742] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:03.545049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:03.566356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e67af-f5e2-4085-9610-99cd4bb185ca None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:03.582015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:03.582852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:03.583290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:03.583714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:03.584522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:03.584995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:03.587907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:03.653656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:03.664571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 865/1743] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:03.667129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0afa1a-63cb-4d1d-b27b-776565d7a5f3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:03.732320 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:03.732972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:03.733788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:03.734060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:03.734749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:03.738180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:03.754061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:03.755893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:03.788992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1604-bf08-4f92-b2a5-9e7ceabada50 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:03.807599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:03.808233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:03.809515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:03.809515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] PATH_INFO: `/v3/users/83ccc3b56e774807820c6534127bfe57` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:03.815721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ccc3b56e774807820c6534127bfe57)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:03.817670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:03.843964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 879/1744] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:03 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:03.847344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:03.876750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:03.939065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ccc3b56e774807820c6534127bfe57'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.955943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ccc3b56e774807820c6534127bfe57'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.957076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ccc3b56e774807820c6534127bfe57'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.958017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ccc3b56e774807820c6534127bfe57'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:03.976050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef687415-bdc4-4aab-8ff7-4b0cfccec466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ccc3b56e774807820c6534127bfe57'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:04.027210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 866/1745] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:03 2022] DELETE /identity/v3/users/83ccc3b56e774807820c6534127bfe57 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:04.031517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.033547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.034110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.094059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb7c7-e612-4ad6-80bb-639d463f7403 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:04.120862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:04.123038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:04.300863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:04.301530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.301981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.302406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.303477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:04.305959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:04.338596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 867/1746] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:04.351887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:04.353626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:04.361950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 880/1747] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:03 2022] POST /identity/v3/users => generated 294 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:04.366203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:04.381754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:04.399031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:04.431690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f59c6-f1be-4903-bc94-bcca10b12578 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:04.445666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:04.446294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.446596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.446865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.447830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:04.449608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:04.480446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 881/1748] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:04.484429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:04.516957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa13-e6c4-43da-8c15-86d359ff2378 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:04.543255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:04.544153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.544429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.544700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.545345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:04.550789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:04.596876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 882/1749] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:14:04.598222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:04.628790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb8987-f185-4b77-8969-ce39c8f88ade admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:04.647943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:04.648790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.651444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.651926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] PATH_INFO: `/v3/projects/5ab433c73c8b456faf03f33ab5769b74/users/dc121e1cd1404afbb635b910685be092/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.666470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ed60-7f39-433f-83d2-4aac1ed1fd8e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:04.679251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:04.698253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.698698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.698988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.703871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab433c73c8b456faf03f33ab5769b74, user_id=dc121e1cd1404afbb635b910685be092, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:04.714172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:04.740340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:04.746765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738895-4010-403d-9aaf-81d1f5f0de5c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:04.757828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 883/1750] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:04 2022] PUT /identity/v3/projects/5ab433c73c8b456faf03f33ab5769b74/users/dc121e1cd1404afbb635b910685be092/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:04.759181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:04.765070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:04.784056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 868/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:04.786776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997608d1-577f-4810-a59d-751fd6c4583f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:04.787071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997608d1-577f-4810-a59d-751fd6c4583f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:04.787350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997608d1-577f-4810-a59d-751fd6c4583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:04.880153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-997608d1-577f-4810-a59d-751fd6c4583f None None] MFA Rules not processed for user `dc121e1cd1404afbb635b910685be092`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:04.881542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-997608d1-577f-4810-a59d-751fd6c4583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:05.005236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858ba3e-e014-43ff-a5d3-ca1d4c510f3e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:05.019255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:05.021328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.024115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.024466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] PATH_INFO: `/v3/users/043609ee9ffc4c8184f955bee3ef4781` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.027103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043609ee9ffc4c8184f955bee3ef4781)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:05.031672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:05.043109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:05.067703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 869/1752] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:05.078950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.080984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.081452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.134157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] MFA Rules not processed for user `dd8269c9310d457ab007d0beec62f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:05.140625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:05.182894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043609ee9ffc4c8184f955bee3ef4781'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:05.202543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043609ee9ffc4c8184f955bee3ef4781'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:05.203259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043609ee9ffc4c8184f955bee3ef4781'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:05.206215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043609ee9ffc4c8184f955bee3ef4781'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:05.224079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6a94415c-9242-4c7b-8468-49a0b61756c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043609ee9ffc4c8184f955bee3ef4781'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:05.234988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 870/1753] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:05.240696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:05.240696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:05.263006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 884/1754] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:04 2022] DELETE /identity/v3/users/043609ee9ffc4c8184f955bee3ef4781 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:05.268023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.268321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.270304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.274140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa7d8e-0d41-4e14-9ead-d442c2ef16f9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:05.311324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:05.312726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:05.456725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:05.497034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:05.498186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.498463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.504408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.505139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:05.508989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:05.533828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 885/1755] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:05.563080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 871/1756] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:05 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:05.568335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:05.582474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6566-c7c6-48f1-9518-85cb9415773f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:05.601175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:05.602955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:05.780707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:05.781538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.781698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.781844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.782470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:05.786022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:05.814019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5846f3-62c4-4e96-a7a2-d812218cd83d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:05.827779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:05.835224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.836458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.836891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.846427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 886/1757] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:05 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:05.850501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:05.872503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:05.876112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d63f-8ebc-4614-a390-b61eda5b93ad service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:05.893974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b351aac-798f-4a5b-bba5-e0535fc25d53 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:05.912002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:05.913087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.915148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.915449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.916583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 872/1758] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:05.918087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:05.921362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:05.932750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:05.935070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:05.937413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:05.937910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:05.956055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 887/1759] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:05.957270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:06.013202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459e5b5-a380-4fca-ac71-b83dcd700819 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:06.032661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:06.034474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] MFA Rules not processed for user `a11490d644a6482689eb26dd6fe965dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:06.035398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:06.036899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:06.039212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] PATH_INFO: `/v3/projects/a8ea2f9a7366492e8f783f120994ee0e/users/36bc4b946ee14711b2a9888f1ced8e32/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:06.044723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:06.110308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea2f9a7366492e8f783f120994ee0e, user_id=36bc4b946ee14711b2a9888f1ced8e32, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:06.122466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:06.207280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 888/1760] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:05 2022] PUT /identity/v3/projects/a8ea2f9a7366492e8f783f120994ee0e/users/36bc4b946ee14711b2a9888f1ced8e32/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:06.213721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:06.381894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 873/1761] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:06.394374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82c6e2-5ae9-4998-8e1a-d3db607d8c6d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:06.407287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:06.408239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:06.408716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:06.409924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:06.411992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:06.415531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdecd0c-5159-4eca-9d60-f8b3f3a12b57 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:06.446228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 889/1762] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:06.450906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:06.483228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c3e4-33b0-4d68-9747-9d8f9ebdb6f7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:06.498381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:06.499882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:06.500309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:06.500732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] PATH_INFO: `/v3/projects/a8ea2f9a7366492e8f783f120994ee0e/users/36bc4b946ee14711b2a9888f1ced8e32/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:06.507410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea2f9a7366492e8f783f120994ee0e, user_id=36bc4b946ee14711b2a9888f1ced8e32, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:06.510322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d8bda-5b22-4a19-b3a1-ff4aa743b01b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:06.559341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 874/1763] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:06 2022] PUT /identity/v3/projects/a8ea2f9a7366492e8f783f120994ee0e/users/36bc4b946ee14711b2a9888f1ced8e32/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:06.560873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:06.561714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:06.561992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:06.576441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:06.576969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:06.577396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:06.662733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] MFA Rules not processed for user `36bc4b946ee14711b2a9888f1ced8e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:06.664010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:06.712222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:06.715553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:06.798926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:06.814165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 890/1764] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:06.828275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:06.832178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:06.892507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 875/1765] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:07.002731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eeb40-f685-4a32-ad3b-e6922f17faa2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:07.010214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:07.011281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:07.015256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:07.016029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:07.054160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:07.060820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:07.079488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:07.104795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 891/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:07.180499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:07.182578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:07.468060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606308-ad09-430d-9fd6-1c6f07a033df None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:07.492662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:07.493358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:07.494118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:07.494501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:07.547488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:07.549139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:07.599400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 876/1767] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:14:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:14:08.631659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:08.636216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:08.835250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:09.037333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cdffa-e7e8-4f6c-903c-ef5cda6253a7 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:09.051372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:09.052208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:09.052647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:09.053111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] PATH_INFO: `/v3/projects/451b2594c0344ddb8d16b1bcb04e691f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:09.057635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451b2594c0344ddb8d16b1bcb04e691f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:09.063339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:09.243893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451b2594c0344ddb8d16b1bcb04e691f', 'request_id': 'req-ada9c721-8419-46d2-bfae-9684d9be0ab4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.249893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab0da-2d4c-460e-a0f6-375af2e32457 service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:09.260587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451b2594c0344ddb8d16b1bcb04e691f', 'request_id': 'req-ada9c721-8419-46d2-bfae-9684d9be0ab4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.272989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451b2594c0344ddb8d16b1bcb04e691f', 'request_id': 'req-ada9c721-8419-46d2-bfae-9684d9be0ab4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.351258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] The token cache is being invalidate because project 451b2594c0344ddb8d16b1bcb04e691f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:09.356607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.362340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.374605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 892/1768] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:08 2022] DELETE /identity/v3/projects/451b2594c0344ddb8d16b1bcb04e691f => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:09.381732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:09.391215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:09.635572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:09.664228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:09.667914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:09.676866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:09.679961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] PATH_INFO: `/v3/users/dc121e1cd1404afbb635b910685be092` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:09.688378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc121e1cd1404afbb635b910685be092)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:09.703071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:09.780511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9c721-8419-46d2-bfae-9684d9be0ab4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:09.809831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:09.810542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:09.810841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:09.811687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] PATH_INFO: `/v3/users/7b71c9ddea5444829d6d798bceb85ccf` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:09.815430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b71c9ddea5444829d6d798bceb85ccf)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:09.830669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:09.942595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc121e1cd1404afbb635b910685be092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.953844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:09.981291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc121e1cd1404afbb635b910685be092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.982576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc121e1cd1404afbb635b910685be092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.984381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc121e1cd1404afbb635b910685be092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:09.985664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b71c9ddea5444829d6d798bceb85ccf'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.010413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b71c9ddea5444829d6d798bceb85ccf'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.012150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b71c9ddea5444829d6d798bceb85ccf'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.012999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b71c9ddea5444829d6d798bceb85ccf'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.028686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc121e1cd1404afbb635b910685be092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.031094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4821710-8958-426b-8bb9-e9b23249bd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b71c9ddea5444829d6d798bceb85ccf'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:10.099473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 893/1769] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:09 2022] DELETE /identity/v3/users/7b71c9ddea5444829d6d798bceb85ccf => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:10.126569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 877/1770] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:08 2022] DELETE /identity/v3/users/dc121e1cd1404afbb635b910685be092 => generated 0 bytes in 1292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:10.131445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:10.131917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:10.132339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:10.172039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:10.180483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:10.486188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 894/1771] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:10.614701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:10.617450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:10.814968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b08577-ddcf-47d8-b474-af6a6cd85a6b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:10.820147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:10.820788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:10.821119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:10.821396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:10.861176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:10.862732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:10.890938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 878/1772] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:11.259074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:11.261469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:11.297523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc33181-7fab-461d-819c-0d3a09832f8d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:11.322798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:11.323471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:11.323760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:11.324034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] PATH_INFO: `/v3/projects/c509e3eb69174b13b8a5d98f8ccf5180` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:11.336371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c509e3eb69174b13b8a5d98f8ccf5180)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:11.338318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:11.527137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c509e3eb69174b13b8a5d98f8ccf5180', 'request_id': 'req-c8518cc4-9c3e-40eb-918a-9372f82530d4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:11.556308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c509e3eb69174b13b8a5d98f8ccf5180', 'request_id': 'req-c8518cc4-9c3e-40eb-918a-9372f82530d4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:11.570778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c509e3eb69174b13b8a5d98f8ccf5180', 'request_id': 'req-c8518cc4-9c3e-40eb-918a-9372f82530d4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:11.634659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] The token cache is being invalidate because project c509e3eb69174b13b8a5d98f8ccf5180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:11.634958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:11.639513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:11.645118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 895/1773] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:11 2022] DELETE /identity/v3/projects/c509e3eb69174b13b8a5d98f8ccf5180 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:11.649241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:11.660483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5310c9-98fe-497c-a197-9500d386f262 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:11.920952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:11.922949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:11.925374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:11.925694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] PATH_INFO: `/v3/users/85ba4468156145a88ad361547a850e4a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:11.929695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ba4468156145a88ad361547a850e4a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:11.940535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:12.010333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:12.075681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:12.078544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:12.105059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518cc4-9c3e-40eb-918a-9372f82530d4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:12.126407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ba4468156145a88ad361547a850e4a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.133266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:12.134113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.134395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.134693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] PATH_INFO: `/v3/projects/b8759675887d4a058b83ffaa4041ce61` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.138574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8759675887d4a058b83ffaa4041ce61)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:12.140614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:12.143447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ba4468156145a88ad361547a850e4a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.144288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ba4468156145a88ad361547a850e4a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.149664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ba4468156145a88ad361547a850e4a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.172677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c8c65d18-d2fe-4688-a358-699a42a49146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ba4468156145a88ad361547a850e4a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.220833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 879/1774] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:11 2022] DELETE /identity/v3/users/85ba4468156145a88ad361547a850e4a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:12.225915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263d6c-0379-40f0-9587-b6255182282e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.228177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263d6c-0379-40f0-9587-b6255182282e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.228487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263d6c-0379-40f0-9587-b6255182282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.233558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:12.286700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8759675887d4a058b83ffaa4041ce61', 'request_id': 'req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.296321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-96263d6c-0379-40f0-9587-b6255182282e None None] MFA Rules not processed for user `6c49fa2c8e9347478e7e434efd0fb80f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:12.302143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96263d6c-0379-40f0-9587-b6255182282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:12.309582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8759675887d4a058b83ffaa4041ce61', 'request_id': 'req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.333187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8759675887d4a058b83ffaa4041ce61', 'request_id': 'req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.384259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] The token cache is being invalidate because project b8759675887d4a058b83ffaa4041ce61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:12.384843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.386293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6ec6c60-e7a1-49a6-b05c-7d7eb8347f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:12.392066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 896/1775] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:12 2022] DELETE /identity/v3/projects/b8759675887d4a058b83ffaa4041ce61 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:12.393753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.394210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.394659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.444719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:12.446409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:12.538158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 880/1776] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:12.575358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 897/1777] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:12.584299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.584664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.584999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.643014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:12.648406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:12.705616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 881/1778] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:12.711074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:12.724877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473b4d-ee42-48f7-9569-66ef3f64a2d4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:12.736426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:12.738782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.741039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.741531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.743214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:12.745918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:12.747920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:12.790786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:12.796388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 898/1779] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:12.808913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e679cc0-188e-4a33-8185-3d04590d7ee1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:12.822542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:12.824619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.825378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.825810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.827794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:12.830740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:12.853639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:12.859254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:12.912240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34e15-616f-41e7-a020-3c1b8699fef8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:12.940092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:12.941143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:12.941631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:12.946034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] PATH_INFO: `/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:12.949722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7c5a27060d43ee9f3f2a52ddf0def3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:12.956661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:12.964555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 882/1780] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:12 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:12.967197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:13.133148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7c5a27060d43ee9f3f2a52ddf0def3', 'request_id': 'req-8bf14753-8de4-4431-a296-46a622d9b259'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:13.151271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7c5a27060d43ee9f3f2a52ddf0def3', 'request_id': 'req-8bf14753-8de4-4431-a296-46a622d9b259'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:13.183371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7c5a27060d43ee9f3f2a52ddf0def3', 'request_id': 'req-8bf14753-8de4-4431-a296-46a622d9b259'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:13.220596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76013-5bdf-4e79-88f1-a4736169655e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:13.254430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] The token cache is being invalidate because project 3c7c5a27060d43ee9f3f2a52ddf0def3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:13.258795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:13.264605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bf14753-8de4-4431-a296-46a622d9b259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:13.281023 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 899/1781] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:12 2022] DELETE /identity/v3/projects/3c7c5a27060d43ee9f3f2a52ddf0def3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:13.284888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.286514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.289344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:13.290955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:13.396436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:13.406279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:13.495560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:13.497276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.497756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.499749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:13.500694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:13.502319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:13.504789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7c9e-caaf-4039-927e-b36ad6028353 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:13.607241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 883/1782] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:12 2022] POST /identity/v3/users => generated 285 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:13.607241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f20e3-72f2-4d8e-ae22-aca23243ffb8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.607241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f20e3-72f2-4d8e-ae22-aca23243ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.607241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f20e3-72f2-4d8e-ae22-aca23243ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:13.674067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 900/1783] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Sep 19 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:13.678429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:13.690536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:13.724641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e95f20e3-72f2-4d8e-ae22-aca23243ffb8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:13.734143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e95f20e3-72f2-4d8e-ae22-aca23243ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:13.761737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a8143-e030-4177-90c8-26a26631edf6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:13.787919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 884/1784] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:13.790587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.797159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.797971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:13.803957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:13.807535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.809812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.810438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:13.813299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:13.823465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:13.879623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 901/1785] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:13.885341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:13.891305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:13.893044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:13.902417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:13.941538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 885/1786] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:13.944081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:13.961015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a665bbd-8402-48ca-8796-50975f021db3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:13.978641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:13.986868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae68ab0-3267-439c-ab2a-600cc2827d3c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:13.994148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:13.994929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:13.995544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] PATH_INFO: `/v3/projects/5ab433c73c8b456faf03f33ab5769b74` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.003473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.004105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.004379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.004505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab433c73c8b456faf03f33ab5769b74)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.004644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.005291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.013532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.033824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.042454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 886/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:14.043771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.074252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc393ec-c543-452b-852a-b5fc7c8809c4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.089025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.089663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.089935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.090205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.091073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:14.091435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.099165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.130896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 887/1788] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:14.131754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.161772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96158d-12c9-47ad-8f87-a7fc247ad8a5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.192894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.197538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.201017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.203404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] PATH_INFO: `/v3/projects/7cffbbb9c8744e13bfa5ad82c4e6003e/users/dfafbf02da304c41a079dc2a935dc53d/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.236573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab433c73c8b456faf03f33ab5769b74', 'request_id': 'req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.254964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cffbbb9c8744e13bfa5ad82c4e6003e, user_id=dfafbf02da304c41a079dc2a935dc53d, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.258190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab433c73c8b456faf03f33ab5769b74', 'request_id': 'req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.258443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.276877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab433c73c8b456faf03f33ab5769b74', 'request_id': 'req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.286667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 888/1789] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:14 2022] PUT /identity/v3/projects/7cffbbb9c8744e13bfa5ad82c4e6003e/users/dfafbf02da304c41a079dc2a935dc53d/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:14.287923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.302801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] The token cache is being invalidate because project 5ab433c73c8b456faf03f33ab5769b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:14.303407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.304256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-267db2ff-6b7d-4dfc-80ff-ada49d7b6f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.311403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 902/1790] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:13 2022] DELETE /identity/v3/projects/5ab433c73c8b456faf03f33ab5769b74 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:14.313964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.314643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.315162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.411262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] MFA Rules not processed for user `dfafbf02da304c41a079dc2a935dc53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:14.414609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:14.476322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b4b4-a23c-4646-9053-71e9098e403f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.488784 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.489424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.489712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.489985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.490693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.492879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.574879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 889/1791] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:14 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:14.576350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.579257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:14.641908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:14.692602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 903/1792] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:14.695740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.700422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b745-2477-46e0-907a-65ae06b9445f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.703763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:14.705847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.706714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.707215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.707755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] PATH_INFO: `/v3/users/36bc4b946ee14711b2a9888f1ced8e32` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.709629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36bc4b946ee14711b2a9888f1ced8e32)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.711954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.768817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f4da-0c77-4c45-8635-97c299eeaa56 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.786889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.788255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.789510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.790247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.791514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.831516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.848410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36bc4b946ee14711b2a9888f1ced8e32'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.874110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36bc4b946ee14711b2a9888f1ced8e32'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.874868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36bc4b946ee14711b2a9888f1ced8e32'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.876257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36bc4b946ee14711b2a9888f1ced8e32'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.891261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36bc4b946ee14711b2a9888f1ced8e32'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:14.913668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 904/1793] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:14 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:14.916291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.919048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:14.945628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dec9d-c3cd-4db4-bd69-3d093cdb821f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:14.956835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:14.957851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:14.958029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:14.958815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:14.960386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:14.962914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:14.983948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 890/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:14 2022] DELETE /identity/v3/users/36bc4b946ee14711b2a9888f1ced8e32 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:14.984940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:14.989708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:14.998596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:15.023487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 905/1795] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:14 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:15.030143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.226901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fecec-1f21-4463-8599-b3891d596bde admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.241921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.242807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.243093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.243579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.244609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.253496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:15.267301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daed43-395b-4e93-977f-133402d5bdbf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.283266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.284018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.284302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.284664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.285513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.287494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:15.324244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 906/1796] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:15 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:15.330080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.357286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d424-b112-4741-b9f0-b441bc369834 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.357913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 891/1797] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:15.361372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.375890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.376955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.377412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.378081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.379103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.381342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:15.413220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 907/1798] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:15.434426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.460564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdefebf-50fc-4517-be46-c0c99b02c6db admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.461441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dca26a-bd6d-4fc6-80ad-ecc607b7082a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.492431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.496564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.501291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.501878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] PATH_INFO: `/v3/projects/b3bd3a71f35b4d56802242de5cb8d354/users/bb8d0f700ef7463cae3511338dee089a/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.509261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.511634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.511826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.514637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.515842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.540661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:15.612482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bd3a71f35b4d56802242de5cb8d354, user_id=bb8d0f700ef7463cae3511338dee089a, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.626722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:15.642469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 892/1799] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:15.644645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.649728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:15.683516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831227b-52c0-4e74-b5cb-dea697d17180 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:15.697532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 908/1800] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:15 2022] PUT /identity/v3/projects/b3bd3a71f35b4d56802242de5cb8d354/users/bb8d0f700ef7463cae3511338dee089a/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:15.699345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:15.782665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:15.952851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:15.956350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:15.958398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:15.959283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] PATH_INFO: `/v3/projects/a8ea2f9a7366492e8f783f120994ee0e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:15.962464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ea2f9a7366492e8f783f120994ee0e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:15.992918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:16.015048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04aa8-bb0a-4f85-8620-4787359ddf59 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:16.056739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:16.061491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:16.066405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:16.068586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] PATH_INFO: `/v3/projects/3680ff0d869146beb3e747ced5a1108d/users/291c2f162e3647c9a70920566fa7120d/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:16.162425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3680ff0d869146beb3e747ced5a1108d, user_id=291c2f162e3647c9a70920566fa7120d, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:16.173501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:16.250348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ea2f9a7366492e8f783f120994ee0e', 'request_id': 'req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:16.257398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 909/1801] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:15 2022] PUT /identity/v3/projects/3680ff0d869146beb3e747ced5a1108d/users/291c2f162e3647c9a70920566fa7120d/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:16.265142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:16.266976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ea2f9a7366492e8f783f120994ee0e', 'request_id': 'req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:16.285645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ea2f9a7366492e8f783f120994ee0e', 'request_id': 'req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:16.371535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] The token cache is being invalidate because project a8ea2f9a7366492e8f783f120994ee0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:16.373634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:16.376645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:16.390817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 893/1802] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:15 2022] DELETE /identity/v3/projects/a8ea2f9a7366492e8f783f120994ee0e => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:16.392522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:16.399175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:16.435616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:16.540981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1b9f-c61f-46ac-bf85-5f7ad315f280 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:16.571226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:16.574027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:16.574333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:16.578650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:16.579949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:16.581820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:16.613280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 910/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:16.616429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:16.628995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:16.731386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c354d-a636-4d88-ab9c-21c76e9adfaf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:16.909887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45114548-d561-4368-b22b-fb0e674abce1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:16.926728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:16.930416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:16.930731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:16.931009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:16.936719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:16.964431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:16.965397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:16.965397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:16.965649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:16.971827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:16.977576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa6596-4850-403c-b408-870fe7ea4ebb service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:17.012637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:17.017981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e115c9-942f-4acc-917a-8e01bc3e80bf service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:17.023278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 911/1804] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:17.026715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addcb-a8b0-41f7-a625-03917c69d52a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.027108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addcb-a8b0-41f7-a625-03917c69d52a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.028019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addcb-a8b0-41f7-a625-03917c69d52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.058568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 894/1805] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:17.068520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.070689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.070995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.126792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e08addcb-a8b0-41f7-a625-03917c69d52a None None] MFA Rules not processed for user `291c2f162e3647c9a70920566fa7120d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:17.128088 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e08addcb-a8b0-41f7-a625-03917c69d52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.187293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:17.188546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.234638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 895/1806] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:17.234638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:17.236759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.284682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 912/1807] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:17.284682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.284682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.284682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.286074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a492a-3963-4157-8a23-a434617dd9c0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:17.307849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:17.308255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:17.308392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.308770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.309150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] PATH_INFO: `/v3/projects/b3bd3a71f35b4d56802242de5cb8d354/users/bb8d0f700ef7463cae3511338dee089a/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.309652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.315866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bd3a71f35b4d56802242de5cb8d354, user_id=bb8d0f700ef7463cae3511338dee089a, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:17.318783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:17.333755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 913/1808] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:17.334974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:17.336606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.352061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 896/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:17 2022] PUT /identity/v3/projects/b3bd3a71f35b4d56802242de5cb8d354/users/bb8d0f700ef7463cae3511338dee089a/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:17.353348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:17.362650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:17.541986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:17.550097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba0a56-4cc7-4baf-96b7-24847339baca admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:17.573892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:17.575015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.575015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.575347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.582206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:17.582614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:17.592759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac7870-4d5c-4c2e-aff3-5bc76393f7b4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:17.604249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d80da-113c-42a5-8f00-6cd0a59f2218 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:17.644487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 897/1810] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:17.653500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.653797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.654075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.723007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] MFA Rules not processed for user `bb8d0f700ef7463cae3511338dee089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:17.741247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:17.741699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:17.741699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:17.741699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:17.741699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:17.899290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:17.908311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:17.950444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 914/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:17.954394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:17.987182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d693191-1547-428e-8b80-1221ba348ff9 service glance] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:17.994521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 898/1812] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:18.007218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.012333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.012333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.012333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:18.014475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:18.017272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:18.023560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:18.028936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:18.096518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 915/1813] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:17 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:18.101907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:18.379291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc5f6-4a51-4e07-bed4-6e9625740526 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:18.388505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5afcd-9c11-4c2b-aa34-2b65261838c9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:18.398201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.400280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.401720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.401720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:18.401720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:18.412575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:18.539246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 916/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:18 2022] POST /identity/v3/users => generated 292 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:18.547119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:18.587101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:18.610001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40014619-58d4-4988-926b-d5c0609f52dc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:18.643989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.647621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.651121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.652923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:18.654190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:18.668100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.669045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.669325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.670712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:18.679190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:18.753823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 917/1815] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:18.754224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:18.792197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:18.809195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ffdd-6a46-4957-b435-b293cccd5eb6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:18.835641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.836735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.839102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.839901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:18.842636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:18.845502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:18.915274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 918/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:18.920861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:18.944622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:18.949737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e66a-f049-4d62-b1c0-5f3fd2d37ab3 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:18.961895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb3a5-65c8-476e-9644-b1ad061d0f78 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:18.991038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 899/1817] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 972 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:18.994355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:18.995172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:18.995496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:18.995883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] PATH_INFO: `/v3/projects/abdfebad21ed48e1bc83c04b50614135/users/ed68b19af0d649e58726b648ef62c04e/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:19.074366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdfebad21ed48e1bc83c04b50614135, user_id=ed68b19af0d649e58726b648ef62c04e, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:19.087127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:19.122524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 919/1818] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:18 2022] PUT /identity/v3/projects/abdfebad21ed48e1bc83c04b50614135/users/ed68b19af0d649e58726b648ef62c04e/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:19.128602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:19.130132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:19.130609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:19.197462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] MFA Rules not processed for user `ed68b19af0d649e58726b648ef62c04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:19.204443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:19.469347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 900/1819] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:19.473762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:19.789479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e21c6-97bc-4454-9451-4ff9d9164395 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:19.809294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:19.810062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:19.810554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:19.811492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:19.836535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:19.839058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:19.978912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 920/1820] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:19 2022] POST /identity/v3/projects => generated 383 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:19.982037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:20.001272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c1d77-007a-459b-9cc1-04f437280eb6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:20.223173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:20.223773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:20.224053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:20.224308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:20.224950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:20.230513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:20.292022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 901/1821] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:19 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:20.298137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:20.322498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96687-bf0b-41aa-bac7-22bb009ba0ca admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:20.336408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:20.340504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:20.340943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:20.341259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:20.342049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:20.351595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:20.393378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 921/1822] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:20.394561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:20.460655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451a01-7651-4921-984f-efd456441a91 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:20.494808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:20.494808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:20.494808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:20.494808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] PATH_INFO: `/v3/projects/19f7e7827cb64f36b0b063d0347d06ba/users/b9565ea6368c44f0ba8d44cee7e39957/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:20.514837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:20.588950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f7e7827cb64f36b0b063d0347d06ba, user_id=b9565ea6368c44f0ba8d44cee7e39957, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:20.591779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339862e-6437-446c-b85a-7008b5b6eb0d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:20.642909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:20.654707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 902/1823] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:20 2022] PUT /identity/v3/projects/19f7e7827cb64f36b0b063d0347d06ba/users/b9565ea6368c44f0ba8d44cee7e39957/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:20.666295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe9fe-9829-4a2e-a773-312ada763aff admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:20.784508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:20.785525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:20.785848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:20.868134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:20.875876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:20.936517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:20.939232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:20.939727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:20.940185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:20.942030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:20.947018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:20.990076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 922/1824] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:20.997010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:21.048706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2b70-3cf5-4719-859e-142141613b28 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:21.071512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:21.073893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:21.092278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:21.093480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] PATH_INFO: `/v3/projects/19f7e7827cb64f36b0b063d0347d06ba/users/b9565ea6368c44f0ba8d44cee7e39957/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:21.104119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f7e7827cb64f36b0b063d0347d06ba, user_id=b9565ea6368c44f0ba8d44cee7e39957, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:21.121279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 903/1825] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:21.127433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d181bc-7245-412a-ba23-c1e00684870f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:21.139212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:21.141159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:21.191064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 923/1826] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:20 2022] PUT /identity/v3/projects/19f7e7827cb64f36b0b063d0347d06ba/users/b9565ea6368c44f0ba8d44cee7e39957/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:21.211277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:21.212501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:21.213024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:21.357733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] MFA Rules not processed for user `b9565ea6368c44f0ba8d44cee7e39957`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:21.359006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:21.433128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:21.490740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d79d1-f488-4914-998d-c3ee0d16aadc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:21.578650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 924/1827] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:21.587480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:21.590083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:21.772357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc2281-f5dd-4b0b-92c5-9f2fd4b8ad68 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:21.788995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:21.790948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:21.792252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:21.793903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:21.833694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:21.840145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:21.867675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:21.870369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:21.871047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:21.874274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:21.894216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 925/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:22.071222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:22.199638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:22.203108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa4398-9c3a-4d10-aac1-0675e465c336 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:22.222538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:22.243296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ad2e6-a57d-42c0-b634-2fdfc8f3f908 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:22.273539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 904/1829] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 16:14:22.308480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:22.312131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:22.314783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:22.315301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:22.801183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:22.816980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9675ff-373a-463a-8422-e932217aa256 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:22.881315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 926/1830] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:22.934584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b3ba-33e6-4156-92bb-757904e2dee6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:22.934584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b3ba-33e6-4156-92bb-757904e2dee6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:22.934584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b3ba-33e6-4156-92bb-757904e2dee6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:22.942258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 905/1831] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:14:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:14:22.962544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:22.964261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:22.964810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:23.099013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:23.101039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:23.410070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:23.601824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 927/1832] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:14:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 641 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:23.886042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b3ba-33e6-4156-92bb-757904e2dee6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:24.086557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:24.101938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a6a4-9539-4737-bbf9-25c838074f33 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:24.106719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b3ba-33e6-4156-92bb-757904e2dee6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:24.115195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:24.115869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.116158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.116630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] PATH_INFO: `/v3/users/ed68b19af0d649e58726b648ef62c04e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.117939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed68b19af0d649e58726b648ef62c04e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:24.119548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:24.120084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:24.125577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.126177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.127068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] PATH_INFO: `/v3/users/dfafbf02da304c41a079dc2a935dc53d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.128657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfafbf02da304c41a079dc2a935dc53d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:24.130915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:24.248843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed68b19af0d649e58726b648ef62c04e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.294436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfafbf02da304c41a079dc2a935dc53d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.314104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed68b19af0d649e58726b648ef62c04e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.315022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed68b19af0d649e58726b648ef62c04e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.316381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed68b19af0d649e58726b648ef62c04e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.327059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfafbf02da304c41a079dc2a935dc53d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.339902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfafbf02da304c41a079dc2a935dc53d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.346346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfafbf02da304c41a079dc2a935dc53d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.361835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-151fbac8-8623-468c-ae66-ab542f4ad469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed68b19af0d649e58726b648ef62c04e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.391377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bb7673b7-ae8e-454d-a194-c13b4c750b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfafbf02da304c41a079dc2a935dc53d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:24.425105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 906/1833] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:23 2022] DELETE /identity/v3/users/dfafbf02da304c41a079dc2a935dc53d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:24.439003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.439298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.439650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.444452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 928/1834] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:24 2022] DELETE /identity/v3/users/ed68b19af0d649e58726b648ef62c04e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:24.452575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.453065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.454157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.502803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:24.504369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:24.524244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:24.531695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:24.589005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:24.610584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 907/1835] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:24.611912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:24.613785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:24.673522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 929/1836] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:24.674729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:24.684832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:24.785395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1cfde-522a-4f67-9766-99900a912a91 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:24.811285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:24.813945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.815167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.815910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.824659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:24.873552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:24.879717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:24.893889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78ffe-5ff7-4122-9272-d5dc8cd456a6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:24.904750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:24.906005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.907066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.907825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.910791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 908/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:24.912935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:24.936429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc42e3-9930-4fb3-b823-c18a3f72ba39 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:24.936945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:24.944386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a17b-c628-4a54-9f04-ddf94d0851d4 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:24.950322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:24.951396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:24.951836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:24.952259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:24.958238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:24.975635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:24.975871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 930/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:24.977484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e127b-7511-47fc-8049-116ea0ea5910 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:25.003097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 909/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:25.617134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001831fe-6201-4f1c-ab60-20f67fa10820 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:25.617861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001831fe-6201-4f1c-ab60-20f67fa10820 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:25.618632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001831fe-6201-4f1c-ab60-20f67fa10820 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:25.621343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 931/1840] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:14:25.934352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:25.935429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:25.935914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:25.957175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:25.959215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:25.972610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 910/1841] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:26.559216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001831fe-6201-4f1c-ab60-20f67fa10820 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:26.580220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001831fe-6201-4f1c-ab60-20f67fa10820 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:26.587139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:26.588235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:26.588794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:26.589389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:26.603928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:26.606299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:26.639604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 932/1842] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:26.648554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:26.650206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:26.682680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2958b9-b578-4fdf-b1fb-504000295630 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:26.689011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:26.689912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:26.690933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:26.691447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] PATH_INFO: `/v3/projects/7cffbbb9c8744e13bfa5ad82c4e6003e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:26.692856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cffbbb9c8744e13bfa5ad82c4e6003e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:26.695757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:26.809287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cffbbb9c8744e13bfa5ad82c4e6003e', 'request_id': 'req-7e58b816-b5ff-4897-bc1a-8fd214db55c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:26.829496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cffbbb9c8744e13bfa5ad82c4e6003e', 'request_id': 'req-7e58b816-b5ff-4897-bc1a-8fd214db55c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:26.840340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cffbbb9c8744e13bfa5ad82c4e6003e', 'request_id': 'req-7e58b816-b5ff-4897-bc1a-8fd214db55c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:26.856392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] The token cache is being invalidate because project 7cffbbb9c8744e13bfa5ad82c4e6003e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:26.857600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:26.859005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:26.861528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 911/1843] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:26 2022] DELETE /identity/v3/projects/7cffbbb9c8744e13bfa5ad82c4e6003e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:26.866244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:26.888378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061aef1-0d2f-482b-93ba-8e78b17671aa service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:27.002444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:27.005786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:27.008787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:27.009086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] PATH_INFO: `/v3/users/bb8d0f700ef7463cae3511338dee089a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:27.010473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8d0f700ef7463cae3511338dee089a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:27.012753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:27.111274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8d0f700ef7463cae3511338dee089a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.128992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8d0f700ef7463cae3511338dee089a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.129913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8d0f700ef7463cae3511338dee089a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.130998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8d0f700ef7463cae3511338dee089a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.148381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8d0f700ef7463cae3511338dee089a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.163795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:27.166660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:27.178185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 933/1844] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:26 2022] DELETE /identity/v3/users/bb8d0f700ef7463cae3511338dee089a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:27.230782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58b816-b5ff-4897-bc1a-8fd214db55c7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:27.297187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:27.335435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:27.336535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:27.336924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:27.337352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] PATH_INFO: `/v3/projects/abdfebad21ed48e1bc83c04b50614135` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:27.338779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdfebad21ed48e1bc83c04b50614135)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:27.341005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:27.409747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdfebad21ed48e1bc83c04b50614135', 'request_id': 'req-259faac7-d558-4b9b-9822-ac3594d1cdcd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.423215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdfebad21ed48e1bc83c04b50614135', 'request_id': 'req-259faac7-d558-4b9b-9822-ac3594d1cdcd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.444608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdfebad21ed48e1bc83c04b50614135', 'request_id': 'req-259faac7-d558-4b9b-9822-ac3594d1cdcd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.476091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] The token cache is being invalidate because project abdfebad21ed48e1bc83c04b50614135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:27.476846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.478065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.481328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 912/1845] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:27 2022] DELETE /identity/v3/projects/abdfebad21ed48e1bc83c04b50614135 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:27.486516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:27.488970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:27.522991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6f31-3166-4b61-a922-55f789607669 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:27.665970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:27.667140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:27.668040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:27.669325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] PATH_INFO: `/v3/users/b9565ea6368c44f0ba8d44cee7e39957` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:27.672381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9565ea6368c44f0ba8d44cee7e39957)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:27.677045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:27.703450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:27.803790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9565ea6368c44f0ba8d44cee7e39957'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.821203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9565ea6368c44f0ba8d44cee7e39957'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.823067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9565ea6368c44f0ba8d44cee7e39957'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.824524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9565ea6368c44f0ba8d44cee7e39957'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.846426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f7a780a8-d0ca-4770-a1ec-804ed43fdcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9565ea6368c44f0ba8d44cee7e39957'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:27.934710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 934/1846] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:27 2022] DELETE /identity/v3/users/b9565ea6368c44f0ba8d44cee7e39957 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:28.618683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:28.624306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:28.651232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259faac7-d558-4b9b-9822-ac3594d1cdcd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:28.781195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:28.782378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:28.783136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:28.783587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] PATH_INFO: `/v3/projects/b3bd3a71f35b4d56802242de5cb8d354` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:28.785258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bd3a71f35b4d56802242de5cb8d354)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:28.787442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:28.902874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bd3a71f35b4d56802242de5cb8d354', 'request_id': 'req-57da9e6c-bc54-4ebc-9979-d2fb291267a1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:28.915955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bd3a71f35b4d56802242de5cb8d354', 'request_id': 'req-57da9e6c-bc54-4ebc-9979-d2fb291267a1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:28.926932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bd3a71f35b4d56802242de5cb8d354', 'request_id': 'req-57da9e6c-bc54-4ebc-9979-d2fb291267a1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:28.941399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] The token cache is being invalidate because project b3bd3a71f35b4d56802242de5cb8d354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:28.941691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:28.946545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-57da9e6c-bc54-4ebc-9979-d2fb291267a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:28.949003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 913/1847] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:28 2022] DELETE /identity/v3/projects/b3bd3a71f35b4d56802242de5cb8d354 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:28.956324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:28.957116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:28.957574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.021056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:29.022604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:29.135769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 935/1848] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:29.141971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.142261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.142766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.163235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:29.212512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:29.214197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:29.243039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 914/1849] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:29.249116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.277916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52b5c9-8f9c-4a60-be1e-766758254978 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.290204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.291152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.291591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.292029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.294194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:29.295575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.297614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.313274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 936/1850] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:29.316868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.330834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09448-27b7-4857-9ff3-847f20ebc261 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.336266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.340333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.340791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.341143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.342567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.344634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.380387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 915/1851] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:29.385031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.396721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515b795-5f99-4d21-95da-16a9ff00ae2c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.474523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.475518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.475892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.476246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.476995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.479188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.516516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 937/1852] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:29 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:29.522135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.542532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00057c-d85d-4b13-8f64-53c27139eb97 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.548585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.549332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.549797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.550296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.551089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.553145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.573291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 916/1853] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:29.577649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.583705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:29.596239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b907a-94d2-42c6-917d-41fc3985b17d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.607997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.608849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.609194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.609533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.610263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.612154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4961-3d7e-49ea-8b3a-22790878d1fc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.631782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 938/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:29.636153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:29.653563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb2dbe-8ef4-4e33-b4fd-7840c9d72528 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:29.661849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:29.662561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.662909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.663257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] PATH_INFO: `/v3/projects/3308b372d0c0484aa0754a8067b45eb4/users/d46a77141e2c4ae6873d2f5766b2c909/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.689046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3308b372d0c0484aa0754a8067b45eb4, user_id=d46a77141e2c4ae6873d2f5766b2c909, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:29.694078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:29.751373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 917/1855] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:29 2022] PUT /identity/v3/projects/3308b372d0c0484aa0754a8067b45eb4/users/d46a77141e2c4ae6873d2f5766b2c909/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:29.754929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:29.755401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:29.755790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:29.805102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] MFA Rules not processed for user `d46a77141e2c4ae6873d2f5766b2c909`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:29.806946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:29.920779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 939/1856] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:29.925520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.043937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.045877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:30.068916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677b6e-6203-470b-8179-f1bdcd5d8e86 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:30.078903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:30.079952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.080394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.081008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.082639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:30.087041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:30.193511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 918/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:30.198952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.225110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51d9f-739f-4815-a6b8-02525488ba09 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:30.375216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb06c57-d017-4c74-a812-99689055e5d0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:30.394381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:30.395657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.397377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.397921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.399034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:30.402117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:30.407852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:30.408971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.409448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.410052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] PATH_INFO: `/v3/projects/19f7e7827cb64f36b0b063d0347d06ba` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.414465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f7e7827cb64f36b0b063d0347d06ba)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:30.451638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:30.475037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 919/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:30 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:30.480836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.505948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6710b-6562-4d03-9486-056907154e69 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:30.523158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:30.523854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.524096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.524361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.525094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:30.531394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:30.540003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:30.587099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 920/1859] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:30.593331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.601396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f7e7827cb64f36b0b063d0347d06ba', 'request_id': 'req-da6e72a2-7335-40a5-b01e-d5c2d590391c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:30.609357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:30.626434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5036-20a8-45f7-8668-e3c0338d5426 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:30.629677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f7e7827cb64f36b0b063d0347d06ba', 'request_id': 'req-da6e72a2-7335-40a5-b01e-d5c2d590391c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:30.650274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f7e7827cb64f36b0b063d0347d06ba', 'request_id': 'req-da6e72a2-7335-40a5-b01e-d5c2d590391c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:30.682423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] The token cache is being invalidate because project 19f7e7827cb64f36b0b063d0347d06ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:30.683418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:30.686742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-da6e72a2-7335-40a5-b01e-d5c2d590391c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:30.695989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 940/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:30 2022] DELETE /identity/v3/projects/19f7e7827cb64f36b0b063d0347d06ba => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:30.702047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b50c8-fe85-4864-9d5f-8099749fec92 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.702888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b50c8-fe85-4864-9d5f-8099749fec92 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.703479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b50c8-fe85-4864-9d5f-8099749fec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.744767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3b3b50c8-fe85-4864-9d5f-8099749fec92 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:30.746822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b3b50c8-fe85-4864-9d5f-8099749fec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:30.785203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:30.786698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.787519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.788192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] PATH_INFO: `/v3/projects/8f3ee666473540bf8f8b8101c20fad6a/users/2f5198a5b11d4f27b59af6a8b9abedb2/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.845445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3ee666473540bf8f8b8101c20fad6a, user_id=2f5198a5b11d4f27b59af6a8b9abedb2, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:30.852034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:30.886884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 921/1861] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:30 2022] PUT /identity/v3/projects/8f3ee666473540bf8f8b8101c20fad6a/users/2f5198a5b11d4f27b59af6a8b9abedb2/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:30.888022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:30.890524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 941/1862] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:30.900974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:30.901492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:30.901701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:30.901882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:30.949132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:30.954827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.055046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 942/1863] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:31.059799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.066563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6a17-f205-458e-9a99-3e5aded6934e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.071240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8988-32a5-45cc-a88b-007d85198b73 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.073015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.073762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.074138 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.074557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.075313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.078056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.078242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.079411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.080022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.080817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.081668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:31.082427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.084786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.104632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 943/1864] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:14:31.107379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.109826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 922/1865] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:31.110863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.124914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8305fd-2625-4623-b36e-705931fd01ee admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.127775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343716f-c9fb-4ccc-85fa-59d2256fce5c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.132200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.132833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.133111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.133383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.134025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.135617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.136486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.137087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.137375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.137799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] PATH_INFO: `/v3/projects/8f3ee666473540bf8f8b8101c20fad6a/users/2f5198a5b11d4f27b59af6a8b9abedb2/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.141894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3ee666473540bf8f8b8101c20fad6a, user_id=2f5198a5b11d4f27b59af6a8b9abedb2, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.145025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b555f1e-11df-421b-86d2-8b20462b216a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.184477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 923/1866] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:31 2022] PUT /identity/v3/projects/8f3ee666473540bf8f8b8101c20fad6a/users/2f5198a5b11d4f27b59af6a8b9abedb2/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:31.189005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.189005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.189447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.191638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 944/1867] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:31 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:31.196829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.266181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:31.321783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] MFA Rules not processed for user `2f5198a5b11d4f27b59af6a8b9abedb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:31.323170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.346470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb65ead-cf6a-4c25-a8dc-ea3b2b895177 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.354674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.357512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.358474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.361299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.362278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.367191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.413986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 945/1868] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:31 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:31.415960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.430875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a788-3287-41d4-81d1-d7d98d7cc460 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.437283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.437955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.438236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.438773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.439520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.441445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:31.443698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.457076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 924/1869] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:31.466365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 946/1870] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:31.469092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.469659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.471734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.487019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c97f-6ef0-485b-b19a-5f221d43d0a0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.494791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.495929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.496721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.497504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.499248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.502053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.519490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 925/1871] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:31.526165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.542850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3377-ae6b-4d8c-accd-b1fa8226330b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.553932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.559021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.560774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.561657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] PATH_INFO: `/v3/projects/28dddf84c26543d3be546c50cb723c1f/users/34529a94e63e449f9fe2bf6ffd55ded9/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.566131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748acc72-6104-47af-bfce-c10b6d211fd4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:31.571456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:31.572287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.572673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.573051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.575441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.600872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dddf84c26543d3be546c50cb723c1f, user_id=34529a94e63e449f9fe2bf6ffd55ded9, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.609757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83785-9869-4d84-b752-f90a1a5c92d5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.646067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 926/1872] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:31 2022] PUT /identity/v3/projects/28dddf84c26543d3be546c50cb723c1f/users/34529a94e63e449f9fe2bf6ffd55ded9/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:31.657602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:31.657952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:31.658168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:31.718972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] MFA Rules not processed for user `34529a94e63e449f9fe2bf6ffd55ded9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:31.720670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.764210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:31.767073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:31.800378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 947/1873] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:31.913144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 927/1874] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:31.939439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:31.941119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:31.983777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964679c-b8bb-4ce6-8503-1e20412f4f85 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:32.143373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:32.146329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:32.149626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:32.150593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:32.184699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:32.188556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e956a-0c16-4ecc-b0d5-5a98436dd473 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:32.203206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:32.217718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 948/1875] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:32.258990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:32.469810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16efa27-ebbb-4442-81db-6148e4a8b187 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:32.488707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:32.489413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:32.489692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:32.489968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] PATH_INFO: `/v3/users/34529a94e63e449f9fe2bf6ffd55ded9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:32.491312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=34529a94e63e449f9fe2bf6ffd55ded9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:32.494323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:32.640184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34529a94e63e449f9fe2bf6ffd55ded9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:32.651222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:32.661353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34529a94e63e449f9fe2bf6ffd55ded9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:32.665722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34529a94e63e449f9fe2bf6ffd55ded9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:32.667621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34529a94e63e449f9fe2bf6ffd55ded9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:32.690371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34529a94e63e449f9fe2bf6ffd55ded9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:32.750548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 928/1876] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:32 2022] DELETE /identity/v3/users/34529a94e63e449f9fe2bf6ffd55ded9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:32.756692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe4737-ff22-4210-a5c1-fc8895333c6a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:32.757539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe4737-ff22-4210-a5c1-fc8895333c6a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:32.762804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe4737-ff22-4210-a5c1-fc8895333c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:32.830883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6cfe4737-ff22-4210-a5c1-fc8895333c6a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:32.832474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6cfe4737-ff22-4210-a5c1-fc8895333c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:32.939349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 949/1877] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:32.947302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:32.950038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:32.969987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9362cf-ffc5-41c1-a399-ff9e04f96017 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:32.970499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9362cf-ffc5-41c1-a399-ff9e04f96017 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:32.970934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9362cf-ffc5-41c1-a399-ff9e04f96017 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:32.974719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 950/1878] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:14:33.016895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:33.017738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:33.018362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:33.099065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:33.101555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:33.139468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a09ab8-5065-42d0-b55c-0ed84cea1aab admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:33.152067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:33.153303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:33.154777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:33.155404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:33.190216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:33.191761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:33.221986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 929/1879] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:33.302641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:33.546032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:33.548324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:33.612233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877ee2-bf59-4720-851f-d84e99250d99 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:33.632765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:33.635274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:33.635526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:33.638611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:33.684563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:33.689426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13400e-3b20-4cfb-a323-e20d464d7a21 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:33.719317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 930/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:33.754637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:33.756745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:33.819498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457bc1-83dd-4df6-b9f6-b812d25b036a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:33.846327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:33.847495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:33.847987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:33.848486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] PATH_INFO: `/v3/projects/28dddf84c26543d3be546c50cb723c1f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:33.853952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dddf84c26543d3be546c50cb723c1f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:33.857824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.021455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dddf84c26543d3be546c50cb723c1f', 'request_id': 'req-be7e5703-2bc2-48e2-b492-12afe174896f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:34.033750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dddf84c26543d3be546c50cb723c1f', 'request_id': 'req-be7e5703-2bc2-48e2-b492-12afe174896f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:34.042111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dddf84c26543d3be546c50cb723c1f', 'request_id': 'req-be7e5703-2bc2-48e2-b492-12afe174896f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:34.077841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] The token cache is being invalidate because project 28dddf84c26543d3be546c50cb723c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:34.078880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:34.087288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-be7e5703-2bc2-48e2-b492-12afe174896f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:34.091314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 952/1882] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:33 2022] DELETE /identity/v3/projects/28dddf84c26543d3be546c50cb723c1f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:34.096429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.097695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.097695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.134630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:34.136302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:34.258085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 931/1883] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:34.266388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.266892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.267183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.292151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:34.294013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:34.303558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 953/1884] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:34.308989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.322695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554001-975e-4ed5-ab82-aba9d6002dc9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.335757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.336438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.336722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.337001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.340223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:34.340598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.344398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.406471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.411506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 932/1885] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:34.423730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf1d50-160e-46dc-91ad-6a90924d1422 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.437192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.438277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.438827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.439313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.440158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.443647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.455851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:34.505779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 954/1886] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:34 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:34.507786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.526312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6531-d454-44f9-840e-25ba839e482e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.620549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:34.645461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.646801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.647277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.648016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.651268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.654107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.698927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.733246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 933/1887] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:34 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:34.740494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392230a-5bc9-4ff9-a2f6-ab864ead7af6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.745536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.746609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.746910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.747360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.748014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.749685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.768787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 955/1888] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:34.770424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.784467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ba44-e70e-4af4-b441-8e8dc87aaf6e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.792275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.792908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.793442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.793698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.794893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.796359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed8336-5ee6-44bd-b0e4-90c1b4990a6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.815499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 934/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:34.818576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:34.831783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caab37-ba9e-4686-8fab-b53e0d6ad006 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:34.838109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:34.839070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.839664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.839876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] PATH_INFO: `/v3/projects/245798afa93f4be6bffd329135837001/users/67acb752fb014f92aa6069a51fc91d93/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.862096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245798afa93f4be6bffd329135837001, user_id=67acb752fb014f92aa6069a51fc91d93, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:34.869944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:34.890890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 956/1890] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:34 2022] PUT /identity/v3/projects/245798afa93f4be6bffd329135837001/users/67acb752fb014f92aa6069a51fc91d93/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:34.902834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:34.904726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:34.905216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:34.947909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] MFA Rules not processed for user `67acb752fb014f92aa6069a51fc91d93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:34.949972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:35.142998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 935/1891] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:35.164790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:35.167187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:35.177427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:35.178905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:35.264934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798b55-66f1-4ade-92c3-8c2c5e2f67a8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:35.274597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:35.276517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:35.277112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:35.278242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:35.298132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:35.301897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:35.318106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 957/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:35.347677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d416e-3acc-4391-b9f2-fc157f06b74c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:35.362713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:35.364051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:35.364547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:35.365133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:35.369100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:35.542097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:35.545092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dc273-c813-4c53-b674-ed0b49b0e285 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:35.564511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 936/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:45.315104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:45.555097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:49.644686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:49.782273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582b32-2104-4944-a375-0408d2297a2d service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:49.787267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:49.787923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:49.788210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:49.788508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] PATH_INFO: `/v3/users/67acb752fb014f92aa6069a51fc91d93` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:49.789689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67acb752fb014f92aa6069a51fc91d93)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:49.791715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:49.849972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67acb752fb014f92aa6069a51fc91d93'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:49.860901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67acb752fb014f92aa6069a51fc91d93'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:49.861850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67acb752fb014f92aa6069a51fc91d93'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:49.862757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67acb752fb014f92aa6069a51fc91d93'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:49.874432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67acb752fb014f92aa6069a51fc91d93'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:49.901334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 958/1894] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:49 2022] DELETE /identity/v3/users/67acb752fb014f92aa6069a51fc91d93 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:49.907972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:49.908841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:49.908841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:49.934411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:49.936216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:50.041703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 937/1895] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:50.057728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:50.060577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:50.187243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8a6dc-2d54-45a1-b12e-242a09d9a6e1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:50.194539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:50.195953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:50.196994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:50.197480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:50.221433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:50.224404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deefaa3-573b-49c1-bc18-c8c5a563dde5 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:50.245973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 959/1896] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:50.844152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:50.846712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:50.889334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2519-e372-4a90-b68b-d255c485a9d4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:50.907732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:50.908539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:50.909469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:50.909469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] PATH_INFO: `/v3/projects/245798afa93f4be6bffd329135837001` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:50.911209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=245798afa93f4be6bffd329135837001)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:50.914035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.030651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245798afa93f4be6bffd329135837001', 'request_id': 'req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.051309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245798afa93f4be6bffd329135837001', 'request_id': 'req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.070186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245798afa93f4be6bffd329135837001', 'request_id': 'req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.089880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] The token cache is being invalidate because project 245798afa93f4be6bffd329135837001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:51.089880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.090502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c66ef5c7-d564-41b5-a7ca-da50a0cdc22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.094796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 938/1897] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:50 2022] DELETE /identity/v3/projects/245798afa93f4be6bffd329135837001 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:51.101174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.101855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.102840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.132346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:51.133479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.162910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:51.227880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 960/1898] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:51.237335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.237673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.237875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.259558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:51.260815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.269308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 939/1899] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:51.274102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.285395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4f7d7-625d-4cc8-943f-ac1c6a507423 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:51.292004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:51.292637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.293322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.294336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.295548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:51.296104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:51.299203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.320753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.323353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.325407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 961/1900] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:51.336173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.350079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd586b7-21ef-41b1-93bf-f8393b8a11bf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:51.360247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d62da-296c-452e-87da-46d56b467dc6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:51.365181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:51.365982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.366401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.367435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] PATH_INFO: `/v3/users/d46a77141e2c4ae6873d2f5766b2c909` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.369351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46a77141e2c4ae6873d2f5766b2c909)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:51.372956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.376289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:51.380870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.381659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.382106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.383354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:51.387192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.484576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 962/1901] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:51 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:51.491340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.508514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46a77141e2c4ae6873d2f5766b2c909'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.532078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46a77141e2c4ae6873d2f5766b2c909'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.534018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46a77141e2c4ae6873d2f5766b2c909'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.548153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46a77141e2c4ae6873d2f5766b2c909'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.577823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1881a7c1-126a-47ea-8c5d-7e11d98bafe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46a77141e2c4ae6873d2f5766b2c909'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:51.604236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:51.637749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 940/1902] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:51 2022] DELETE /identity/v3/users/d46a77141e2c4ae6873d2f5766b2c909 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:51.659745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.660394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.661018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.693744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b665-ec3c-45c9-9995-7de401519af0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:51.712567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:51.718743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.830439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:51.831871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.832266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.832666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.833493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:51.837242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.865450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 941/1903] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:51.883363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 963/1904] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:51 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:51.885802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.889859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:51.890082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.892334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:51.914027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3274aa-1441-4622-ad68-710a26239147 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:51.921410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:51.922734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:51.923197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:51.923663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:51.925081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:51.928042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:51.964264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:51.972009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 942/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:51.990262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:52.036448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b437-8d82-4443-88b5-819347e11f43 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:52.054700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:52.055929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:52.056550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:52.057786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:52.061003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:52.067493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:52.124341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635807e1-8701-4826-a617-ad58d78bb13d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:52.126389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 943/1906] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:52.131582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:52.142775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:52.144303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:52.145820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:52.146244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:52.155828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd28402-eaa0-44fd-8622-56d49e267f28 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:52.162781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:52.165184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:52.165583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:52.165717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796167af-95b7-407b-b0bf-6792de9735ab service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:52.165909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:52.166435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] PATH_INFO: `/v3/projects/300e5dea5f7343d5aa0652d690c02894/users/c5968f03b83b42d69db0d4473da71e52/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:52.200472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 964/1907] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:52.208604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=300e5dea5f7343d5aa0652d690c02894, user_id=c5968f03b83b42d69db0d4473da71e52, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:52.219933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:52.252714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 944/1908] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:52 2022] PUT /identity/v3/projects/300e5dea5f7343d5aa0652d690c02894/users/c5968f03b83b42d69db0d4473da71e52/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:52.273291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:52.278398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:52.279911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:52.344727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] MFA Rules not processed for user `c5968f03b83b42d69db0d4473da71e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:52.347427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:52.501006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 965/1909] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:52.519729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:52.524247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:52.660359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf6346-f295-4621-b6f2-1a78ea39fd3a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:52.669305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:52.670830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:52.671521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:52.672128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:52.705209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:52.714651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:52.781906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 945/1910] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:53.568567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:53.572173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:53.792330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558f640-a32f-4ef0-82e4-cf451f99c1c3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:53.803386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:53.805776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:53.806603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:53.807851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] PATH_INFO: `/v3/projects/3308b372d0c0484aa0754a8067b45eb4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:53.812577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3308b372d0c0484aa0754a8067b45eb4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:53.817903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:53.960533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3308b372d0c0484aa0754a8067b45eb4', 'request_id': 'req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:53.974255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3308b372d0c0484aa0754a8067b45eb4', 'request_id': 'req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:53.978733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:53.986644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3308b372d0c0484aa0754a8067b45eb4', 'request_id': 'req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.013136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] The token cache is being invalidate because project 3308b372d0c0484aa0754a8067b45eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:54.013547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.014695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.017576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 966/1911] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:53 2022] DELETE /identity/v3/projects/3308b372d0c0484aa0754a8067b45eb4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:54.022892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:54.045012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff17aa-2ee5-4da8-b977-2ce0f9b071ed service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:54.146714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:54.174177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:54.175294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:54.175780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:54.176252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] PATH_INFO: `/v3/users/2f5198a5b11d4f27b59af6a8b9abedb2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:54.178581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5198a5b11d4f27b59af6a8b9abedb2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:54.182257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:54.302938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5198a5b11d4f27b59af6a8b9abedb2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.326348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5198a5b11d4f27b59af6a8b9abedb2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.336664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5198a5b11d4f27b59af6a8b9abedb2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.341723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5198a5b11d4f27b59af6a8b9abedb2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.398591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-991bc18c-75d1-413d-9a85-07467e474425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5198a5b11d4f27b59af6a8b9abedb2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:54.460612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 946/1912] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:54 2022] DELETE /identity/v3/users/2f5198a5b11d4f27b59af6a8b9abedb2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:55.352528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:55.357812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:55.421182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b9e6-47e6-4483-bc48-8c2d603c0b2d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:55.704734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:55.705475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:55.705948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:55.706411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] PATH_INFO: `/v3/projects/8f3ee666473540bf8f8b8101c20fad6a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:55.714081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3ee666473540bf8f8b8101c20fad6a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:55.717421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:55.944916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3ee666473540bf8f8b8101c20fad6a', 'request_id': 'req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:55.968702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3ee666473540bf8f8b8101c20fad6a', 'request_id': 'req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:55.981920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3ee666473540bf8f8b8101c20fad6a', 'request_id': 'req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:56.011509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] The token cache is being invalidate because project 8f3ee666473540bf8f8b8101c20fad6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:56.013109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:56.014163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7b82184-66e5-4d1f-a7f4-d95d6ad0d399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:56.021212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 967/1913] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:55 2022] DELETE /identity/v3/projects/8f3ee666473540bf8f8b8101c20fad6a => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:56.023886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:56.024532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:56.024738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:56.109754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:56.113016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:56.262977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 947/1914] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:56.271790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:56.272286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:56.272767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:56.348223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:56.358599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:56.405518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 968/1915] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:56.410095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:56.442460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865154bb-7bcb-4487-af2a-d5c85526e5e0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:56.461651 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:56.462694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:56.463175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:56.463646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:56.464795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:14:56.465871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:56.479301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:56.541903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 948/1916] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:14:56.552595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:56.579601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d205c7c-5a21-4f56-93c5-d22f138988ab None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:56.615841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:56.616864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:56.617355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:56.617805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:56.618894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:56.635976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:56.751689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 969/1917] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:56 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:56.752178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:56.791720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d618a39-6d5b-4cfe-9615-a76e2627d8fd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:56.916760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:56.936145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:56.937469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:56.938059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:56.938675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:56.940427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:56.944422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:56.975917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 949/1918] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:56 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:14:56.980963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:56.998683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d0fa-62df-4049-a8d2-bbb420c4b10a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.006880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.007954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.008448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.009490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.010137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.013744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.034682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 970/1919] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:57.039787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.058872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f51a-7169-404c-be97-54d15a21d414 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.070064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.071266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.071736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.072211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.075024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.077275 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553f11-d404-410c-8ce3-80cd89c7ad3d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.098450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 950/1920] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:57.106900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.123480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750b57-e35c-4159-8b60-58f63f0884d1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.131470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.132382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.132698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.133077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] PATH_INFO: `/v3/projects/d1853dc5f7af48868091e4020929f348/users/baab2321d28d42d8a1193b92c2f3b683/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.165031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1853dc5f7af48868091e4020929f348, user_id=baab2321d28d42d8a1193b92c2f3b683, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.171672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.195451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 971/1921] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:57 2022] PUT /identity/v3/projects/d1853dc5f7af48868091e4020929f348/users/baab2321d28d42d8a1193b92c2f3b683/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:57.215638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.217053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.217631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.300271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] MFA Rules not processed for user `baab2321d28d42d8a1193b92c2f3b683`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:57.302518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:57.430733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 951/1922] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:57.437793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.470119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:57.553334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebc685-6d3f-4032-9494-24ba740b0fd9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.561960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.563043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.563535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.563989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.565276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.568861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.619748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 972/1923] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:14:57 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:57.621101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.634786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e7e8b-5d5f-4217-8621-5c236e57c828 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.790379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.791909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.792899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.794336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.795802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.800660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.845115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 952/1924] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:14:57 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:14:57.848887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.867632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679c81-5556-48d9-860a-92f7c5d4418f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.878440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.879421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.879902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.880388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.881575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:57.884621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:57.906738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 973/1925] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:14:57.911952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.945584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3e477-1728-4e33-a52c-2a0022ee998a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:57.959074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:57.960433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:57.960925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:57.961629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] PATH_INFO: `/v3/projects/c7d8580302034172aab74b276407e4ec/users/0da72c1809444689aa26df569e21d2ef/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:57.974415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:57.978231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:58.004628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d8580302034172aab74b276407e4ec, user_id=0da72c1809444689aa26df569e21d2ef, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.011255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.022688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e974f-c8d9-42ee-ab7b-45de92373f0d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:58.038655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 953/1926] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:57 2022] PUT /identity/v3/projects/c7d8580302034172aab74b276407e4ec/users/0da72c1809444689aa26df569e21d2ef/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:58.048825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:58.117137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:58.169248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:58.170183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.170696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.171182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] PATH_INFO: `/v3/users/c5968f03b83b42d69db0d4473da71e52` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.178148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5968f03b83b42d69db0d4473da71e52)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.182072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.196573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb27f6-506f-4ce6-bcdf-36ef5b76c63b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:58.203025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:58.203732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.204009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.204405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.205057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.207287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.228200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 954/1927] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:14:58.229498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:58.242479 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a72282-8eca-4d57-a222-80390a04919f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:58.249622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:58.250411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.250717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.250984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] PATH_INFO: `/v3/projects/c7d8580302034172aab74b276407e4ec/users/0da72c1809444689aa26df569e21d2ef/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.253305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d8580302034172aab74b276407e4ec, user_id=0da72c1809444689aa26df569e21d2ef, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.256025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6401399-abfd-42b0-bc8e-81cb1a7099d1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.299591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5968f03b83b42d69db0d4473da71e52'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:58.307297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 955/1928] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:14:58 2022] PUT /identity/v3/projects/c7d8580302034172aab74b276407e4ec/users/0da72c1809444689aa26df569e21d2ef/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:58.318215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.318687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.319099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.324948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5968f03b83b42d69db0d4473da71e52'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:58.326179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5968f03b83b42d69db0d4473da71e52'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:58.327822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5968f03b83b42d69db0d4473da71e52'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:58.348481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7821fb22-ce77-4b36-b50f-da8c3aadb2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5968f03b83b42d69db0d4473da71e52'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:58.377675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] MFA Rules not processed for user `0da72c1809444689aa26df569e21d2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:58.380051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:58.390901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 974/1929] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:57 2022] DELETE /identity/v3/users/c5968f03b83b42d69db0d4473da71e52 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:14:58.396010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.396408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.396850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.415009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:58.432744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:58.436575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:58.516933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 956/1930] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:58.519732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 975/1931] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:14:58.535863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:58.537309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:58.538930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:58.547393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:58.645472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002423-f288-43f2-8f3e-635cbd5f396f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:58.663742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc733-f65a-4b60-85a3-87ddc6e42327 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:58.670533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:58.672011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.672670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.673376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.694648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.699412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.722538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 976/1932] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:14:58.738646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:58.739719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:58.740431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:58.741096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:58.750447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:58.896424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:58.914531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd49a7-2878-4829-8313-48b275ae96af service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:58.926259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 957/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:58.979736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:58.983010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:59.015773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defbd52-57c0-4e3d-808d-40f460cec032 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:59.033541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:59.035542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:59.036734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:59.037372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] PATH_INFO: `/v3/users/baab2321d28d42d8a1193b92c2f3b683` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:59.049239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baab2321d28d42d8a1193b92c2f3b683)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:59.055347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:59.143122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baab2321d28d42d8a1193b92c2f3b683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.154735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baab2321d28d42d8a1193b92c2f3b683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.155549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baab2321d28d42d8a1193b92c2f3b683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.156479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baab2321d28d42d8a1193b92c2f3b683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.165690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baab2321d28d42d8a1193b92c2f3b683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.198498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 977/1934] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:14:58 2022] DELETE /identity/v3/users/baab2321d28d42d8a1193b92c2f3b683 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:59.204875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:59.205596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:59.205807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:59.268468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:59.290933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:59.416818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:59.419293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:59.491253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 958/1935] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:14:59.508160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:14:59.511351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:59.520110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:14:59.600258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf6ee-cf34-424f-8fc5-c87d2ea4c676 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:59.606259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:59.607306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:59.607804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:59.608292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] PATH_INFO: `/v3/projects/300e5dea5f7343d5aa0652d690c02894` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:59.609706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300e5dea5f7343d5aa0652d690c02894)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:59.613851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:59.645641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3911aa6-6162-4b4b-9551-7b6d825e0f12 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:14:59.657002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:14:59.658522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:59.658907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:59.659283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:59.672815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:14:59.681410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a741b84-22aa-4990-9db6-a3732bb3f2d3 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:14:59.695688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 959/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:14:59.777464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300e5dea5f7343d5aa0652d690c02894', 'request_id': 'req-07557611-4f7f-41d0-a0ea-76ac2b12ee16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.796339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300e5dea5f7343d5aa0652d690c02894', 'request_id': 'req-07557611-4f7f-41d0-a0ea-76ac2b12ee16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.814919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300e5dea5f7343d5aa0652d690c02894', 'request_id': 'req-07557611-4f7f-41d0-a0ea-76ac2b12ee16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.861897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] The token cache is being invalidate because project 300e5dea5f7343d5aa0652d690c02894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:14:59.862610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.863979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-07557611-4f7f-41d0-a0ea-76ac2b12ee16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:14:59.866848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 978/1937] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:14:59 2022] DELETE /identity/v3/projects/300e5dea5f7343d5aa0652d690c02894 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:14:59.874973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:14:59.875351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:14:59.875577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:14:59.904834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:14:59.906185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:14:59.984593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:00.086743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 960/1938] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:00.100207 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.100675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.101148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.143921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:00.146022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:00.165280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 979/1939] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:00.172203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.201164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e573a9-e505-4c13-83d7-8afb8c05b9a8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.210230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.213098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.213759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.215791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.217211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:00.218302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.223173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.242237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 961/1940] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:15:00.258713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.265240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.267274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:00.270995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9499d3-eee2-48be-b8c6-16e8ff8bb0d3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.282529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.283616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.284071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.284564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.288151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.289391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadffba-2a75-447c-a827-148fa0f84a2c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.292057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.309927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.310674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.310963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.311242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] PATH_INFO: `/v3/projects/d1853dc5f7af48868091e4020929f348` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.312535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1853dc5f7af48868091e4020929f348)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.314681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.373119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 980/1941] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:00 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:00.387238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.503438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1853dc5f7af48868091e4020929f348', 'request_id': 'req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.522121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1853dc5f7af48868091e4020929f348', 'request_id': 'req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.536525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1853dc5f7af48868091e4020929f348', 'request_id': 'req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.562383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] The token cache is being invalidate because project d1853dc5f7af48868091e4020929f348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:00.562954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.565772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.569883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 962/1942] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:00 2022] DELETE /identity/v3/projects/d1853dc5f7af48868091e4020929f348 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:00.570575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fb74-5cb3-4d3c-b5e6-05f69c9dc51e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.576633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.578964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:00.639595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:00.710786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.712653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.713282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.714055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.716196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.726383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.754727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58357d-732f-4d3c-b1f0-9ea8cec587f8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.762688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.763573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.763858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.764176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] PATH_INFO: `/v3/users/0da72c1809444689aa26df569e21d2ef` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.766116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da72c1809444689aa26df569e21d2ef)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.768285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.775495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 981/1943] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:00 2022] POST /identity/v3/users => generated 283 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:00.778455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.781223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:00.802979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41aa9a-c840-4159-a1b6-705ecdfdf737 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.811299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.812908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.812908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.813251 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.814146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.816446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.838737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 982/1944] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:00.841943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.852873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da72c1809444689aa26df569e21d2ef'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.861649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c99a2-4837-486b-96c9-1ab3ce4906a2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:00.872332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da72c1809444689aa26df569e21d2ef'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.873030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:00.873532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da72c1809444689aa26df569e21d2ef'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.874643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da72c1809444689aa26df569e21d2ef'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.875260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:00.876087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:00.876916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:00.878825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:00.880163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:00.886720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:00.903508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-71a65db2-3165-4dcf-8299-8d98755a540b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da72c1809444689aa26df569e21d2ef'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:00.928895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 983/1945] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:00.931852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:00.934874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:00.945524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 963/1946] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:00 2022] DELETE /identity/v3/users/0da72c1809444689aa26df569e21d2ef => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:00.962224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6cf8-a31f-4ddd-b268-f1ad901b0b7d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:01.075904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:01.079742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:01.080380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:01.084039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] PATH_INFO: `/v3/projects/7f4e7b39d9dd424e890ddab0c1e6e0f0/users/915617522e474440964bb47ba74408fe/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:01.120258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4e7b39d9dd424e890ddab0c1e6e0f0, user_id=915617522e474440964bb47ba74408fe, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:01.125083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:01.150785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 984/1947] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:00 2022] PUT /identity/v3/projects/7f4e7b39d9dd424e890ddab0c1e6e0f0/users/915617522e474440964bb47ba74408fe/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:01.162087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:01.162435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:01.162752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:01.199055 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] MFA Rules not processed for user `915617522e474440964bb47ba74408fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:01.200872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:01.345487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 964/1948] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:01.398856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:01.403800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:01.545882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f8f2-1d05-4091-b02d-ad225ff7034c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:01.552593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:01.553798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:01.554279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:01.554810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:01.561962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:01.564423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:01.593420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:01.596175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ac8aa-f81d-4875-a40a-5c16e8d44c2f service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:01.616577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 985/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:01.717103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573fb28-9d3d-4a58-9b02-db8418c565be None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:01.727114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:01.727983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:01.732398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:01.732398 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] PATH_INFO: `/v3/projects/c7d8580302034172aab74b276407e4ec` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:01.733987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d8580302034172aab74b276407e4ec)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:01.736586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:01.932215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d8580302034172aab74b276407e4ec', 'request_id': 'req-69dcb95a-18ef-4240-a90c-53b217175f23'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:01.946192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d8580302034172aab74b276407e4ec', 'request_id': 'req-69dcb95a-18ef-4240-a90c-53b217175f23'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:01.960294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d8580302034172aab74b276407e4ec', 'request_id': 'req-69dcb95a-18ef-4240-a90c-53b217175f23'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:01.964096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:02.001283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] The token cache is being invalidate because project c7d8580302034172aab74b276407e4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:02.001773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:02.003334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-69dcb95a-18ef-4240-a90c-53b217175f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:02.006376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 965/1950] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:01 2022] DELETE /identity/v3/projects/c7d8580302034172aab74b276407e4ec => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:02.013157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.013610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.014061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.061548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:02.063627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:02.101202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:02.238917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 986/1951] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:02.242551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.243259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.243889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.302738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:02.303989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:02.312838 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 966/1952] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:02.317458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.330004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78693c-15c3-463e-8f54-c2d78b51ac94 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.338872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.340869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.343268 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.343911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.345220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:02.345842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.349379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.370882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 987/1953] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:02.380588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.398722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fa4b9-039b-4624-9bc2-91b3e957b8cd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.406766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.407794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.408266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.408733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.410627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.413373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.460976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 967/1954] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:02 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:02.467178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.482720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de5f9-f664-4715-b89c-04373179a216 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.602822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.603911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.604395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.604882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.606870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.609141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.637409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 988/1955] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:02 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:02.644933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.659529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4af96-e5ef-48a7-a822-9524c1e76bc2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.676239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.677605 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.678350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.683768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.684564 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.686220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.697717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 968/1956] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:02.702473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.720336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaefb26-abc4-43dd-b389-a2e23d170079 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.732099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.733055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.733453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.733851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.734807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.737067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f206b8b-ceff-41ea-9c28-ebe0acab4709 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.757925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 989/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:02.764357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:02.782620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3707d6-ec88-4138-9092-6073790b685e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:02.791656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:02.793835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.794384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.795011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] PATH_INFO: `/v3/projects/3d5d96e510714894abb5b425fdb5fae6/users/6e16ce0a9b234b3190a8b5db60632621/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.818872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5d96e510714894abb5b425fdb5fae6, user_id=6e16ce0a9b234b3190a8b5db60632621, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:02.823762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:02.845394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 969/1958] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:02 2022] PUT /identity/v3/projects/3d5d96e510714894abb5b425fdb5fae6/users/6e16ce0a9b234b3190a8b5db60632621/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:02.855844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:02.856295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:02.856674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:02.888454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] MFA Rules not processed for user `6e16ce0a9b234b3190a8b5db60632621`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:02.889665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:03.000236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 990/1959] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:03.006758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.087737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f1f21-02b2-4a86-8246-ee4d248f2840 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.093196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.093804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.094079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.094350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.095029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.096925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.128910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 970/1960] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:03 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:03.133507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.151853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665be01a-5f0d-4db5-9c4a-a46510411b71 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.185869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:03.258292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.259288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.259933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.260331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.261188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.264015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.297058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 991/1961] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:03 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:03.305656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.331001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db6c-0ffc-4104-b425-411ecd854924 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.346423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.347400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.347762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.349079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.349752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.360222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.376867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 971/1962] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:03.383772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.410860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52592e6-a0eb-416f-9cec-c33eaa7143db admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.416289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.416955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.417362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.417937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] PATH_INFO: `/v3/projects/e242638ff52c42cc80a74f0bb1d4201d/users/10dacbe9ba614f0aa0dfee8665dc1e0f/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.444481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e242638ff52c42cc80a74f0bb1d4201d, user_id=10dacbe9ba614f0aa0dfee8665dc1e0f, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.447194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.464867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 992/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:03 2022] PUT /identity/v3/projects/e242638ff52c42cc80a74f0bb1d4201d/users/10dacbe9ba614f0aa0dfee8665dc1e0f/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:03.470420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.480992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67901-9328-473c-b75d-db6b368eece9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.578791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.579990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.582967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.586708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.588321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.591963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084a346-3077-4002-ae2e-f6b8ca1a54eb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.602910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:03.613393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 972/1964] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:03.618172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.650098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168a57f-5ec5-4d82-8aa2-8f0dcf8cde20 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.656393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.657029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.657441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.657864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] PATH_INFO: `/v3/projects/e242638ff52c42cc80a74f0bb1d4201d/users/10dacbe9ba614f0aa0dfee8665dc1e0f/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.660311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e242638ff52c42cc80a74f0bb1d4201d, user_id=10dacbe9ba614f0aa0dfee8665dc1e0f, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:03.663154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:03.678520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 993/1965] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:03 2022] PUT /identity/v3/projects/e242638ff52c42cc80a74f0bb1d4201d/users/10dacbe9ba614f0aa0dfee8665dc1e0f/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:03.697016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.697487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.697968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:03.751303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] MFA Rules not processed for user `10dacbe9ba614f0aa0dfee8665dc1e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:03.753270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:03.891040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 973/1966] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:03.909228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:03.912722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:03.988878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07b6f-e1b4-46d4-90d2-70abbe7a257f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:03.995940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:03.997083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:03.997912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:03.998154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:04.015884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:04.019772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5be5-f4c3-4af4-b572-4e9835d4d1cb service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:04.038769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 994/1967] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:04.238533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:04.368410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779af89-eee3-45ad-ae95-e75e1bffe004 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:04.373906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:04.374297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:04.374787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:04.375204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] PATH_INFO: `/v3/users/6e16ce0a9b234b3190a8b5db60632621` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:04.376794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e16ce0a9b234b3190a8b5db60632621)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:04.379042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:04.458732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e16ce0a9b234b3190a8b5db60632621'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:04.472717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e16ce0a9b234b3190a8b5db60632621'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:04.474664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e16ce0a9b234b3190a8b5db60632621'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:04.475951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e16ce0a9b234b3190a8b5db60632621'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:04.496562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e16ce0a9b234b3190a8b5db60632621'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:04.541586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 974/1968] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:04 2022] DELETE /identity/v3/users/6e16ce0a9b234b3190a8b5db60632621 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:04.548538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:04.549240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:04.549883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:04.579113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:04.580646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:04.700031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 995/1969] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:04.712150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:04.714381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:04.724796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:04.809725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d816d8-6bfa-4661-bdde-0ab054fd39e5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:04.814334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:04.814969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:04.815246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:04.815511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:04.826722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:04.828599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:04.839137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 975/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:05.264214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:05.268346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:05.314639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701f7b-8eec-47d6-975e-e6c11c3b55b4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:05.323629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:05.325049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:05.326041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:05.326930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] PATH_INFO: `/v3/projects/3d5d96e510714894abb5b425fdb5fae6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:05.328835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5d96e510714894abb5b425fdb5fae6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:05.332818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:05.354017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:05.426562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5d96e510714894abb5b425fdb5fae6', 'request_id': 'req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.436604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5d96e510714894abb5b425fdb5fae6', 'request_id': 'req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.444865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5d96e510714894abb5b425fdb5fae6', 'request_id': 'req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.463965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] The token cache is being invalidate because project 3d5d96e510714894abb5b425fdb5fae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:05.465072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.465912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.468329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 996/1971] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:05 2022] DELETE /identity/v3/projects/3d5d96e510714894abb5b425fdb5fae6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:05.473738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:05.485021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144e6d-c742-4efd-9bc6-7bfe307dd0b9 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:05.560693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:05.561370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:05.561647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:05.561919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] PATH_INFO: `/v3/users/10dacbe9ba614f0aa0dfee8665dc1e0f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:05.563723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10dacbe9ba614f0aa0dfee8665dc1e0f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:05.567424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:05.641792 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10dacbe9ba614f0aa0dfee8665dc1e0f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.653934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10dacbe9ba614f0aa0dfee8665dc1e0f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.654967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10dacbe9ba614f0aa0dfee8665dc1e0f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.655972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10dacbe9ba614f0aa0dfee8665dc1e0f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.670610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9a83d9b-6370-45eb-88f3-85c3a2d87f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10dacbe9ba614f0aa0dfee8665dc1e0f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:05.701107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 976/1972] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:05 2022] DELETE /identity/v3/users/10dacbe9ba614f0aa0dfee8665dc1e0f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:06.134089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:06.135651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:06.164030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3d1a-54a6-458e-9472-cbf9bad3ad1b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:06.276203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:06.277845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:06.278344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:06.278888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] PATH_INFO: `/v3/projects/e242638ff52c42cc80a74f0bb1d4201d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:06.280863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e242638ff52c42cc80a74f0bb1d4201d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:06.284572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:06.381995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e242638ff52c42cc80a74f0bb1d4201d', 'request_id': 'req-f98edb9b-b2b0-4611-923f-55566b88d820'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:06.399042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e242638ff52c42cc80a74f0bb1d4201d', 'request_id': 'req-f98edb9b-b2b0-4611-923f-55566b88d820'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:06.410384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e242638ff52c42cc80a74f0bb1d4201d', 'request_id': 'req-f98edb9b-b2b0-4611-923f-55566b88d820'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:06.435729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] The token cache is being invalidate because project e242638ff52c42cc80a74f0bb1d4201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:06.436538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:06.438905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f98edb9b-b2b0-4611-923f-55566b88d820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:06.440624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 997/1973] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:06 2022] DELETE /identity/v3/projects/e242638ff52c42cc80a74f0bb1d4201d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:06.447601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:06.448096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:06.449369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:06.484885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:06.486775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:06.541032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:06.648045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 977/1974] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:06.665846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:06.666329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:06.666856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:06.702050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:06.703452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:06.730369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:06.734685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 998/1975] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:06.765520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a9a66-b631-4330-be10-ffdbcf2b5d5e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:06.772607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:06.773619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:06.774044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:06.774591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:06.775726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:06.776249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:06.780947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:06.821711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 978/1976] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:06.823782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:06.846819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348469-1fec-4ee8-b749-59d22e79df14 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:06.859336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:06.860378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:06.860866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:06.861440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:06.862638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:06.866423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:06.905167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:06.919337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 999/1977] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:06 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:06.923828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:06.941700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fdada-051a-4c9b-aa33-74a5cf2023ca admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.030910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.031631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.031934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.032189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.032831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.034844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.068361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 979/1978] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:06 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:07.071611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.087096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefac1-af39-4c33-9a99-2a29988b41f7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.093158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.094102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.094663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.095139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.098001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.099743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.122659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1000/1979] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:07.129294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.148438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c6cf-bcd2-4a7f-9d42-2bc8cffe6e67 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.156828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.157726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.158221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.158752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.159786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.162132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aef25-4d69-44a6-91ce-9f14b562d139 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.178821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 980/1980] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:07.183824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.209051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8504-2d0d-4864-b639-fbf35c9f6ab4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.216912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.218037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.218539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.219032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] PATH_INFO: `/v3/projects/cb8987f5b8e34f23a36a5c32ee470aae/users/b40419d2454548508cf936418fdd833d/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.246369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8987f5b8e34f23a36a5c32ee470aae, user_id=b40419d2454548508cf936418fdd833d, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.251708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.274252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1001/1981] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:07 2022] PUT /identity/v3/projects/cb8987f5b8e34f23a36a5c32ee470aae/users/b40419d2454548508cf936418fdd833d/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:07.285661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.286157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.287828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.337040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] MFA Rules not processed for user `b40419d2454548508cf936418fdd833d`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:07.339099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:07.458750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 981/1982] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:07.459982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.584042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84eb7-df35-40ba-8169-8af8c3fb0819 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.589740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.590551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.590936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.591313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.592131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.594859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.645662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1002/1983] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:07 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:07.651517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.679892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3b4e-3782-4221-a055-e772f8b8cba2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.737173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:07.855413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.856516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.857299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.857919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.860923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.863411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.913076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 982/1984] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:07 2022] POST /identity/v3/users => generated 307 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:07.915267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.935829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bcc20-45d0-44e7-a8f0-36c8b7194469 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:07.944782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:07.946137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:07.946915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:07.947547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:07.948916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:07.954720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:07.990303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:07.999800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1003/1985] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:08.009899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566135a9-4dde-4c5d-aad6-2b0eee382c06 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:08.020798 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:08.021655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:08.022375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:08.022375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] PATH_INFO: `/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3/users/bbd55d17914d41f5bfc8a0d6835751c7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:08.045068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e30cd9d21e4618bfc96fa1705aaca3, user_id=bbd55d17914d41f5bfc8a0d6835751c7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:08.048871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:08.071919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 983/1986] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:07 2022] PUT /identity/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3/users/bbd55d17914d41f5bfc8a0d6835751c7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:08.078054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:08.098045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4d8a-5399-4183-a983-c19f4d7e59da admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:08.315994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:08.321353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:08.321792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:08.322130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:08.323186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:08.326052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eed247-402c-456b-b4d3-e18396a69446 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:08.344686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1004/1987] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:08.346616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:08.373731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e8d1-01ed-4e72-a0ea-77795011b3b0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:08.385537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:08.388271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:08.389064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:08.390009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] PATH_INFO: `/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3/users/bbd55d17914d41f5bfc8a0d6835751c7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:08.394360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e30cd9d21e4618bfc96fa1705aaca3, user_id=bbd55d17914d41f5bfc8a0d6835751c7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:08.403620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:08.446539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 984/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:08 2022] PUT /identity/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3/users/bbd55d17914d41f5bfc8a0d6835751c7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:08.472260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:08.472844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:08.473426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:08.566920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] MFA Rules not processed for user `bbd55d17914d41f5bfc8a0d6835751c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:08.568953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:08.624461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:08.749396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1005/1989] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:08.762874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:08.765488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:08.862820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bfeb-f08d-444d-8e12-601c08079c23 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:08.867185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:08.867844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:08.868121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:08.868387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:08.889861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:08.892436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df529f-8955-49b6-bba1-382919122e73 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:08.923496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 985/1990] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:09.081027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:09.107416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2d27a-830e-4fd9-86c0-c53f281d9827 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:09.118825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:09.119966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:09.121146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:09.121709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:09.266700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:09.269770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e67394-05d3-42d0-861f-1248fee2d1ed service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:09.286067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1006/1991] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:11.585646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.587404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.587890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.591345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 986/1992] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:15:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:15:11.648650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe733-f50d-4e82-9041-b23c987e25eb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.649260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe733-f50d-4e82-9041-b23c987e25eb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.649260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe733-f50d-4e82-9041-b23c987e25eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.673660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5b4fe733-f50d-4e82-9041-b23c987e25eb None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:11.675444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b4fe733-f50d-4e82-9041-b23c987e25eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:11.716789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:11.719259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:11.831596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1007/1993] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:11.842386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc044-f749-4f79-9ac3-3d756c71b7fb None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.843050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc044-f749-4f79-9ac3-3d756c71b7fb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.843540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc044-f749-4f79-9ac3-3d756c71b7fb None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.845156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1008/1994] 10.222.0.27 () {54 vars in 961 bytes} [Mon Sep 19 16:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:15:11.854359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.855357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.855750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.862353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3b83-e29d-4d68-88ca-dd0f3c81de66 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:11.883457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:11.884107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.884485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.884856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] PATH_INFO: `/v3/users/6be676646a3542eba95013af0e37cd91` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.887208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:11.888529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:11.891478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be676646a3542eba95013af0e37cd91)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:11.893720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:11.928188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:11.929730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1009/1995] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Sep 19 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:11.950636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:11.963965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9430-de44-43ed-9b05-f6ac735e3cbe None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:11.970453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:11.971343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:11.971834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:11.972371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:11.989387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be676646a3542eba95013af0e37cd91'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:11.990108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:11.993036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:12.007712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be676646a3542eba95013af0e37cd91'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.008830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be676646a3542eba95013af0e37cd91'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.009471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be676646a3542eba95013af0e37cd91'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.012615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1010/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:12.028755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7cb0b526-e4a5-4f69-b266-e61ceee192d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be676646a3542eba95013af0e37cd91'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.069638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 987/1997] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:11 2022] DELETE /identity/v3/users/6be676646a3542eba95013af0e37cd91 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:12.410948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:12.434751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4890ed-75fc-4853-b2b4-8ff5da02c19a service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:12.492896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:12.533915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:12.534652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:12.534991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:12.535321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] PATH_INFO: `/v3/projects/d4bca7c007f4420781dad62a5590410e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:12.537033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bca7c007f4420781dad62a5590410e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:12.540643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:12.610275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bca7c007f4420781dad62a5590410e', 'request_id': 'req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.619469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bca7c007f4420781dad62a5590410e', 'request_id': 'req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.629695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bca7c007f4420781dad62a5590410e', 'request_id': 'req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.658536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] The token cache is being invalidate because project d4bca7c007f4420781dad62a5590410e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:12.659158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.660093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ced54e0-8d88-46b0-8b9d-5fe40e930db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:12.662721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1011/1998] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:12 2022] DELETE /identity/v3/projects/d4bca7c007f4420781dad62a5590410e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:12.671445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:12.672093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:12.672446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:12.699939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:12.701224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:12.778002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 988/1999] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:12.786698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:12.787090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:12.787246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:12.808717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:12.811456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:12.826400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1012/2000] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:12.832687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:12.848410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39f1c-09a1-49c7-b60e-9ee146df7baa None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:12.856298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:12.857192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:12.857634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:12.858095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:12.859315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:12.859799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:12.862260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:12.878332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 989/2001] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:12.884710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:12.901138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e365ae-ebd6-4632-b401-f3aa6f39a621 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:12.909221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:12.910159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:12.910692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:12.911166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:12.912315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:12.916031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:12.960429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1013/2002] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:12 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:12.966146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:12.980479 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d126be-3eb0-4fbb-87b3-c1fb55cdd0a3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:13.064751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:13.065508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.066185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.066652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.067728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:13.069912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:13.104327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 990/2003] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:12 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:13.113102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:13.126351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10a93-7681-4798-8afa-d349cc04aabd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:13.132560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:13.133240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.133554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.133942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.134985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:13.136861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:13.161380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1014/2004] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:13.163583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:13.182114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d4b6-2b23-423d-8324-076b830e4d59 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:13.188273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:13.188985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.189332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.189705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.190435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:13.192241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72406c0-e63e-472d-8386-e75882702cee admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:13.206465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 991/2005] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:13.211501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:13.228253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df199b4-c0c1-43ba-805c-292814fc1cfb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:13.235093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:13.236043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.236331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.236609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] PATH_INFO: `/v3/projects/64aeec9ace4142cca9576886d350135a/users/12dcbb0f29ea4913a51ede0e3a576517/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.260759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aeec9ace4142cca9576886d350135a, user_id=12dcbb0f29ea4913a51ede0e3a576517, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:13.263721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:13.288049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1015/2006] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:13 2022] PUT /identity/v3/projects/64aeec9ace4142cca9576886d350135a/users/12dcbb0f29ea4913a51ede0e3a576517/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:13.305328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.305936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.306476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.320549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:13.366923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] MFA Rules not processed for user `12dcbb0f29ea4913a51ede0e3a576517`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:13.374673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:13.497112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 992/2007] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:13.515672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:13.518701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:13.654059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:13.682046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5095a-bef8-41b7-a498-34ccc737fc68 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:13.690434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:13.691440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:13.691889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:13.692345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:13.709293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:13.711034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb86f-1bd1-4659-80f2-22db6c21a1d8 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:13.723891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1016/2008] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:14.063669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:14.066926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:14.205325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6134-c58d-4fe5-a895-02f18f94b77d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:14.213091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:14.214533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:14.214734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:14.215154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] PATH_INFO: `/v3/users/b40419d2454548508cf936418fdd833d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:14.217092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40419d2454548508cf936418fdd833d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:14.220408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:14.319014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40419d2454548508cf936418fdd833d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:14.329045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40419d2454548508cf936418fdd833d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:14.330090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40419d2454548508cf936418fdd833d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:14.331084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40419d2454548508cf936418fdd833d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:14.341193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40419d2454548508cf936418fdd833d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:14.363292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 993/2009] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:14 2022] DELETE /identity/v3/users/b40419d2454548508cf936418fdd833d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:14.370304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:14.375084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:14.375588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:14.401863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:14.403879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:14.515020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1017/2010] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:14.526333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:14.531334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:14.556769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:14.626745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c433e-1301-4325-b745-be1a38f1d6e8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:14.631405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:14.632136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:14.632572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:14.633180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:14.645368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:14.647572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:14.660725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 994/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:15.133686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:15.136862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:15.160662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e3e7a-45a9-4497-834d-dabe165485d1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:15.170374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:15.171638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:15.172192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:15.173608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] PATH_INFO: `/v3/projects/cb8987f5b8e34f23a36a5c32ee470aae` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:15.175509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8987f5b8e34f23a36a5c32ee470aae)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:15.177503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:15.241975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8987f5b8e34f23a36a5c32ee470aae', 'request_id': 'req-7aa34c61-7a6d-4b54-8c96-d11200625522'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.251707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8987f5b8e34f23a36a5c32ee470aae', 'request_id': 'req-7aa34c61-7a6d-4b54-8c96-d11200625522'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.260097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8987f5b8e34f23a36a5c32ee470aae', 'request_id': 'req-7aa34c61-7a6d-4b54-8c96-d11200625522'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.279116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] The token cache is being invalidate because project cb8987f5b8e34f23a36a5c32ee470aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:15.279421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.280071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.281579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1018/2012] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:15 2022] DELETE /identity/v3/projects/cb8987f5b8e34f23a36a5c32ee470aae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:15.287962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:15.307542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728dd12-00a6-48f5-b945-a2b5c9bb81b6 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:15.399081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:15.400211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:15.400726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:15.401238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] PATH_INFO: `/v3/users/bbd55d17914d41f5bfc8a0d6835751c7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:15.403313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd55d17914d41f5bfc8a0d6835751c7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:15.405282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:15.469676 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd55d17914d41f5bfc8a0d6835751c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.486395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd55d17914d41f5bfc8a0d6835751c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.487655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd55d17914d41f5bfc8a0d6835751c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.488520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd55d17914d41f5bfc8a0d6835751c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.498994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d045ae76-cb1b-4550-b98d-1b937b6b53bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd55d17914d41f5bfc8a0d6835751c7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:15.528830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 995/2013] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:15 2022] DELETE /identity/v3/users/bbd55d17914d41f5bfc8a0d6835751c7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:16.060272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.061951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:16.077884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34c61-7a6d-4b54-8c96-d11200625522 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.172690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.173510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.173597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.173853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] PATH_INFO: `/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.175002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e30cd9d21e4618bfc96fa1705aaca3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.176918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.189376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:16.245489 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e30cd9d21e4618bfc96fa1705aaca3', 'request_id': 'req-db7eef1d-d93e-4269-8584-d8e65dc7febb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.257756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e30cd9d21e4618bfc96fa1705aaca3', 'request_id': 'req-db7eef1d-d93e-4269-8584-d8e65dc7febb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.267412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e30cd9d21e4618bfc96fa1705aaca3', 'request_id': 'req-db7eef1d-d93e-4269-8584-d8e65dc7febb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.282838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] The token cache is being invalidate because project 99e30cd9d21e4618bfc96fa1705aaca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:16.283372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.284599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-db7eef1d-d93e-4269-8584-d8e65dc7febb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.286421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1019/2014] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:16 2022] DELETE /identity/v3/projects/99e30cd9d21e4618bfc96fa1705aaca3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:16.293783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.294729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.294729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.326530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:16.328429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:16.372176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:16.418649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 996/2015] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:16.430796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.431249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.431630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.456603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:16.457824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:16.466967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1020/2016] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:16.474992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.491102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b8d23-1265-46fc-a745-67fcd09723d3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.497698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.499077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.499749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.500379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.501621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:16.502290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.505314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.525330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 997/2017] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:16.530798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.545520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408da91-de3d-4c74-a9ab-85c3e1376ee8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.554157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.555048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.555474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.555887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.556700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.558896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.595293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1021/2018] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:16.600824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.614758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0f39-e721-4ccd-ae18-dbe244ab5899 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.705362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.706432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.706955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.709334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.709334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.714938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.750553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 998/2019] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:16.756614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.776453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077a401-a3e6-4ac3-a7e9-1869d34140df admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.790711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.790711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.793582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.793582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:16.799273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.799273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.799843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.802015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.821474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b9aa-c1e2-49ba-bd01-1559d4c6c09b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.830535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1022/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:16.833194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.834242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.834858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.835278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] PATH_INFO: `/v3/users/12dcbb0f29ea4913a51ede0e3a576517` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.835451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.837116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12dcbb0f29ea4913a51ede0e3a576517)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.841357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.853205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc88ce-d6ca-4875-9752-fee3ee7ec2f3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.859680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.861063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.861063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.863260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.863260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.864368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.879193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1023/2021] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:16.884205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:16.902616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a3090-ec27-4fcc-941d-eb5fb111772a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:16.910657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:16.911822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.912315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.912826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] PATH_INFO: `/v3/projects/ccbd8072857448e8b9c5b354484265a1/users/632e302c613249449af5621c93ccdb4f/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.920525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12dcbb0f29ea4913a51ede0e3a576517'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.932609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12dcbb0f29ea4913a51ede0e3a576517'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.934363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12dcbb0f29ea4913a51ede0e3a576517'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.935288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12dcbb0f29ea4913a51ede0e3a576517'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.940872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbd8072857448e8b9c5b354484265a1, user_id=632e302c613249449af5621c93ccdb4f, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:16.946234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85804e-66e1-43e7-8fb5-b5eb388a6a5d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:16.946460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a4c6c6-2bad-46d6-a757-de370b9ab61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12dcbb0f29ea4913a51ede0e3a576517'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:16.971710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1024/2022] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:16 2022] PUT /identity/v3/projects/ccbd8072857448e8b9c5b354484265a1/users/632e302c613249449af5621c93ccdb4f/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:16.985992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 999/2023] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:16 2022] DELETE /identity/v3/users/12dcbb0f29ea4913a51ede0e3a576517 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:16.988183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.988722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.989223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:16.992009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:16.992581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:16.993060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.028827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:17.030864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.045199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] MFA Rules not processed for user `632e302c613249449af5621c93ccdb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:17.047393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.065823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:17.171215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1000/2024] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:17.187953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.190518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.192639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1025/2025] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:17.194608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.196889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.219067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435c6b-466b-4ef1-9c0f-b7ea4c2e4593 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.226350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.227333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.227760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.228446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.230215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.233510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.258685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:17.298468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02001-7241-4422-8c23-737f2716d07c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.302437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.303240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.303519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.303788 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.309492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1026/2026] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:17 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:17.311472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.317094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.319480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.343840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1001/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:17.408416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab578-727a-4786-91c2-c1973ba590c5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.413518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.414141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.414620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.414754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.415316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.421795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.470707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1027/2028] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:17 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:17.476196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.490209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a03b83-fc15-416d-9a2e-2d834205cca4 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.495953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.496576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.497034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.497491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.498135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.499775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.513938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1002/2029] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:17.515276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.534735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb129-3008-4773-b80f-b6d48fb46abe admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.540817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.541567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.542193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.543096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.543996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.545673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792182d-c45c-4cca-9dcf-84419a6e5a8f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.556748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1028/2030] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:17.561473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.583013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc1ed-cbb0-4c10-8f29-7f547d16f97f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.593367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.594395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.594890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.595321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] PATH_INFO: `/v3/projects/87407fc583c842e595f00203349c8c83/users/3b7c9d0c7ea74a40bb7460f8449dd177/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.624259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87407fc583c842e595f00203349c8c83, user_id=3b7c9d0c7ea74a40bb7460f8449dd177, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.627121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:17.657294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1003/2031] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:17 2022] PUT /identity/v3/projects/87407fc583c842e595f00203349c8c83/users/3b7c9d0c7ea74a40bb7460f8449dd177/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:17.696345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.696854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.697464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.755387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] MFA Rules not processed for user `3b7c9d0c7ea74a40bb7460f8449dd177`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:17.757304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.834681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.837222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:17.914169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1029/2032] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:17.920339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:17.976157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059641-c1ec-41ff-8678-8e7c27150164 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:17.981159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:17.981789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:17.982061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:17.982329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] PATH_INFO: `/v3/projects/64aeec9ace4142cca9576886d350135a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:17.983508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=64aeec9ace4142cca9576886d350135a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:17.985416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.027694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d21c30-17be-4fb0-b8ec-661fc2d54822 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.035817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.036874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.037336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.037832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.039021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.039672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:18.042799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.049703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:18.060189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64aeec9ace4142cca9576886d350135a', 'request_id': 'req-a693572f-8731-41e7-89b3-2a24b724d2bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:18.072502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64aeec9ace4142cca9576886d350135a', 'request_id': 'req-a693572f-8731-41e7-89b3-2a24b724d2bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:18.079024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1030/2033] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:17 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:18.080865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64aeec9ace4142cca9576886d350135a', 'request_id': 'req-a693572f-8731-41e7-89b3-2a24b724d2bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:18.084673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.096918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] The token cache is being invalidate because project 64aeec9ace4142cca9576886d350135a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:18.097210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:18.097905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a693572f-8731-41e7-89b3-2a24b724d2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:18.099539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1004/2034] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:17 2022] DELETE /identity/v3/projects/64aeec9ace4142cca9576886d350135a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:18.107561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecf52-57ed-4995-b86f-d3b216c0bdaa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.108142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecf52-57ed-4995-b86f-d3b216c0bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.108475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecf52-57ed-4995-b86f-d3b216c0bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.139670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c93ecf52-57ed-4995-b86f-d3b216c0bdaa None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:18.140949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c93ecf52-57ed-4995-b86f-d3b216c0bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.171666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db88b-893e-427d-ab92-a9ea8515e529 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.176620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.177242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.177521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.177793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.178426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.180426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.208279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1031/2035] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:18.213789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.217104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.237877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a84c2-d687-4224-a0dd-600fa547e1b5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.239021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1005/2036] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:18.246658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.247549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.248006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.248453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.249601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.252645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.254165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.254655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.255081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.271132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1032/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:18.278165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.286334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:18.288109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.292224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892319-6dbe-43fc-98d7-7187d138dbe4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.298374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.299096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.299376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.299648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] PATH_INFO: `/v3/projects/b946aeeb831e4d8c926f13f59fc9874b/users/5eb729543bb24458ad9aa76d382dfea4/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.302931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1006/2038] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:18.304359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.317362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9831-5e6e-4dc1-a77e-f8d9da8ddd4e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.323200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.324468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.324748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.325018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.325696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:18.326242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.328463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b946aeeb831e4d8c926f13f59fc9874b, user_id=5eb729543bb24458ad9aa76d382dfea4, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.328724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.332327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.352089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1007/2039] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:18.352366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1033/2040] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:18 2022] PUT /identity/v3/projects/b946aeeb831e4d8c926f13f59fc9874b/users/5eb729543bb24458ad9aa76d382dfea4/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:18.353283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.355095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.366705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1cae-5123-4a7f-9d61-21c38c636333 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.464052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.465424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.465593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.466019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.467436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.470372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.473726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff86520-4018-43d8-9f83-c8aa07d97030 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.486284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.487848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.488420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.489212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.494906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1008/2041] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:18.495666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.495666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.496825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.515570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026f2f3-8f47-45df-9891-462c57698bae admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.523130 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.524154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.524578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.524992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] PATH_INFO: `/v3/projects/b946aeeb831e4d8c926f13f59fc9874b/users/5eb729543bb24458ad9aa76d382dfea4/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.528893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b946aeeb831e4d8c926f13f59fc9874b, user_id=5eb729543bb24458ad9aa76d382dfea4, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.539177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1034/2042] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:18.548505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183bb0-060c-46ee-9124-00eeced80a72 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.551962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.572640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1009/2043] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:18 2022] PUT /identity/v3/projects/b946aeeb831e4d8c926f13f59fc9874b/users/5eb729543bb24458ad9aa76d382dfea4/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:18.596246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:18.654524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.654843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.655115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.665401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137466be-f915-443e-a44d-1312b0a8548b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.691968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] MFA Rules not processed for user `5eb729543bb24458ad9aa76d382dfea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:18.693264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.708635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:18.781388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.782010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.782279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.782581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.783219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.785186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.806090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1010/2044] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:18.816721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1035/2045] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:18 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:18.818823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.820852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.823030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.845039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765e89-bbf0-4987-a708-7c57f7528e4c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.854247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.856072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.856736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.857578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.858849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.861761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.883588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1036/2046] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:18.890539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.908962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4fa4-8557-43fa-8fac-41b4ad84d40c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.916811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.918693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.919191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.919679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.921080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.924181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:18.940101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1037/2047] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:18.946736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:18.953200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a464687-4afc-45ec-8406-8c439a99066f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.959308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.960239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.960535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.960981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.964411 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:18.965325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276552bc-f7e6-4cee-986f-d6c12ef5e3f6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:18.972308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:18.972922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:18.973193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:18.973471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] PATH_INFO: `/v3/projects/ed3059b699914fe08b091e969b9bf86d/users/9a15a4342aff43ee8daf4b4732dddfb8/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:18.990156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3059b699914fe08b091e969b9bf86d, user_id=9a15a4342aff43ee8daf4b4732dddfb8, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:18.992901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750d20f-cf2d-4c99-9629-043ea82069fa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.013406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1038/2048] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:18 2022] PUT /identity/v3/projects/ed3059b699914fe08b091e969b9bf86d/users/9a15a4342aff43ee8daf4b4732dddfb8/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:19.025752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.026170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.027138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.079857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] MFA Rules not processed for user `9a15a4342aff43ee8daf4b4732dddfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:19.081425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.081893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:19.083064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.096401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1011/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:19.197111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1039/2050] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:19.202372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:19.219002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cffbf4-3caf-4c60-849c-aff12e4c1448 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:19.291134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:19.292203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.292942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.294302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.294998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.297969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.314543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:19.353757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1012/2051] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:19 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:19.361125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:19.382049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4ace-989f-4fa6-a4a1-2cb611f43684 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:19.390212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:19.497671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:19.498859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.499275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.499690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.500882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.504055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.566280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1040/2052] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:19 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:19.572012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:19.591227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c481-eb43-4688-aafd-45a30a24cb07 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:19.598203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:19.598977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.599253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.599517 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.600219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.601988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.615350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1013/2053] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:19.619466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:19.631274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517fd8b-dee2-4d15-83f7-a20173719ecb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:19.638687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:19.639654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.640121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.640593 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.641608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.643541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43ef34-2296-4a48-be0a-62b6541d2868 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.663037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1041/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:19.669930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:19.681790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608e13-8343-4973-a2b0-0e5dfa6ec2e3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:19.690202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:19.690979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.691263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.691529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] PATH_INFO: `/v3/projects/c4f6488a99414d11ba4cab6a47facf0d/users/0b40159c3d704ac1b31f5d23871ef50f/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.714133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f6488a99414d11ba4cab6a47facf0d, user_id=0b40159c3d704ac1b31f5d23871ef50f, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:19.717742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:19.732848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1014/2055] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:19 2022] PUT /identity/v3/projects/c4f6488a99414d11ba4cab6a47facf0d/users/0b40159c3d704ac1b31f5d23871ef50f/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:19.744631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:19.745725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:19.746461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:19.780950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] MFA Rules not processed for user `0b40159c3d704ac1b31f5d23871ef50f`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:19.782705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:19.904351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1042/2056] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:19.905994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.019590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078546-c061-405a-bb50-41b384b9a88b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.027298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.028206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.028571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.028946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.029683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.032260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.069019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1015/2057] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:19 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:20.073960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.085117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5f41-d3ee-4ac4-a92c-399e6d33c800 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.158053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.158834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.159147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.159530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.160214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.162288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.197937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1043/2058] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:20 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:20.203055 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.220713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98b138-a7a7-4f2b-b9f8-90b95be5fba0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.227856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.228172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.228372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.228526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.229135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.231409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.253254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1016/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:20.262330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.272793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:20.279992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150a17-5e05-459f-9213-c88b1a43cafa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.287374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.288065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.288342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.288617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] PATH_INFO: `/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370/users/81ddc1e08a4d454780e551858d13d54b/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.316410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ec4f37a6af44ebaf1e5d0a46111370, user_id=81ddc1e08a4d454780e551858d13d54b, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.319237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.336643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1044/2060] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:20 2022] PUT /identity/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370/users/81ddc1e08a4d454780e551858d13d54b/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:20.342662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.357249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2641c-aa66-4a66-89fc-96824e2059af admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.428697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.429309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.429583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.429859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.430526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.432123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5c7a8-327a-4634-931c-eee5a2daae89 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.443782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1017/2061] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:20.448278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.460330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9724b-ebbd-4428-8d16-c974873815e7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.465817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.466472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.466775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.467043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] PATH_INFO: `/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370/users/81ddc1e08a4d454780e551858d13d54b/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.468973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ec4f37a6af44ebaf1e5d0a46111370, user_id=81ddc1e08a4d454780e551858d13d54b, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.471653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.494273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1045/2062] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:20 2022] PUT /identity/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370/users/81ddc1e08a4d454780e551858d13d54b/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:20.512831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.513212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.513618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.550059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] MFA Rules not processed for user `81ddc1e08a4d454780e551858d13d54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:20.551635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:20.573413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:20.662610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1018/2063] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:20.681094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.764392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2ba00-7cf2-473b-bc03-fe1ae374e4b3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.768314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.768929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.769206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.769478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.780346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.781794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.793253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1046/2064] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:20.860833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.864209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:20.865710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:20.873190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6268-828b-468c-a2f8-b32329959ac8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.877322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dcd31-26ec-4861-a3e1-2083b9907615 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:20.878394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.879519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.880029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.880594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.881329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:20.881932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:20.882209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:20.882507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:20.887232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:20.970405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.972172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.984469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:20.987154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:20.991616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1019/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:21.004582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1047/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:21.942320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:21.956167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66860-399d-4508-8c31-343063ce88b7 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:21.961100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:21.961820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:21.962133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:21.962442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:22.049702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:22.051240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd3ed0-0d5b-4119-8094-89ed3db462ca service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:22.062914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1020/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:24.513003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:24.610133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc07472-d76d-4349-b671-e03ed5c858cb service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:24.617802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:24.618925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:24.619401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:24.619827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] PATH_INFO: `/v3/users/9a15a4342aff43ee8daf4b4732dddfb8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:24.621934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a15a4342aff43ee8daf4b4732dddfb8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:24.625478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:24.644582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:24.711748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a15a4342aff43ee8daf4b4732dddfb8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:24.725078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a15a4342aff43ee8daf4b4732dddfb8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:24.726130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a15a4342aff43ee8daf4b4732dddfb8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:24.727177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a15a4342aff43ee8daf4b4732dddfb8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:24.741488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a15a4342aff43ee8daf4b4732dddfb8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:24.773509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1048/2068] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:24 2022] DELETE /identity/v3/users/9a15a4342aff43ee8daf4b4732dddfb8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:24.780957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:24.781597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:24.781839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:24.815280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:24.817310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:24.896590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:24.923554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1021/2069] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:24.940317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:24.946553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:25.039506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8c7c5-90cd-4641-a1df-4da85ef21ffb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:25.055034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:25.056091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:25.056604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:25.057230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:25.076120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:25.078934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:25.098447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1049/2070] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:25.500154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:25.502691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:25.522362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85198db1-8d82-4561-bc9c-9d239d601ea7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:25.527743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:25.528401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:25.528663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:25.528937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] PATH_INFO: `/v3/projects/ed3059b699914fe08b091e969b9bf86d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:25.530175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3059b699914fe08b091e969b9bf86d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:25.532162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:25.600396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3059b699914fe08b091e969b9bf86d', 'request_id': 'req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.609916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3059b699914fe08b091e969b9bf86d', 'request_id': 'req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.616840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3059b699914fe08b091e969b9bf86d', 'request_id': 'req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.631034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] The token cache is being invalidate because project ed3059b699914fe08b091e969b9bf86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:25.631643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.632029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.633593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1022/2071] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:25 2022] DELETE /identity/v3/projects/ed3059b699914fe08b091e969b9bf86d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:25.639285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:25.650796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33403-2bf8-4c91-857a-e03d89f09883 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:25.725990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:25.726793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:25.727136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:25.727538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] PATH_INFO: `/v3/users/0b40159c3d704ac1b31f5d23871ef50f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:25.728882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b40159c3d704ac1b31f5d23871ef50f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:25.732013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:25.787670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:25.805546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b40159c3d704ac1b31f5d23871ef50f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.817036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b40159c3d704ac1b31f5d23871ef50f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.818874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b40159c3d704ac1b31f5d23871ef50f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.818874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b40159c3d704ac1b31f5d23871ef50f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.829069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b40159c3d704ac1b31f5d23871ef50f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:25.851250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1050/2072] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:25 2022] DELETE /identity/v3/users/0b40159c3d704ac1b31f5d23871ef50f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:26.234873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:26.237202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:26.263862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc09b-4b1f-4d4c-9ade-4f73b892100f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:26.372020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:26.372669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:26.372945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:26.373216 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] PATH_INFO: `/v3/projects/c4f6488a99414d11ba4cab6a47facf0d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:26.374385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f6488a99414d11ba4cab6a47facf0d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:26.377497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:26.461145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f6488a99414d11ba4cab6a47facf0d', 'request_id': 'req-a604f54c-27b9-47c6-822e-0888fa038df8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.475135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f6488a99414d11ba4cab6a47facf0d', 'request_id': 'req-a604f54c-27b9-47c6-822e-0888fa038df8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.484464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f6488a99414d11ba4cab6a47facf0d', 'request_id': 'req-a604f54c-27b9-47c6-822e-0888fa038df8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.487248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:26.494240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:26.496510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:26.509157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] The token cache is being invalidate because project c4f6488a99414d11ba4cab6a47facf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:26.509749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.510998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.513492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1023/2073] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:26 2022] DELETE /identity/v3/projects/c4f6488a99414d11ba4cab6a47facf0d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:26.520532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:26.522516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:26.533880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c24d1-b8fa-40eb-8a5f-d2f83e873358 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:26.644154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f54c-27b9-47c6-822e-0888fa038df8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:26.649668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:26.650458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:26.650668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:26.650878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] PATH_INFO: `/v3/users/632e302c613249449af5621c93ccdb4f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:26.652097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:26.652693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632e302c613249449af5621c93ccdb4f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:26.653113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:26.653568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:26.654021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] PATH_INFO: `/v3/users/81ddc1e08a4d454780e551858d13d54b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:26.654714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:26.655893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ddc1e08a4d454780e551858d13d54b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:26.658893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:26.716971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632e302c613249449af5621c93ccdb4f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.732542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632e302c613249449af5621c93ccdb4f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.733402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632e302c613249449af5621c93ccdb4f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.734441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632e302c613249449af5621c93ccdb4f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.740842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ddc1e08a4d454780e551858d13d54b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.745460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-619af0ea-0248-43e0-a136-c9145106b502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632e302c613249449af5621c93ccdb4f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.749289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ddc1e08a4d454780e551858d13d54b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.750157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ddc1e08a4d454780e551858d13d54b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.750816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ddc1e08a4d454780e551858d13d54b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.758688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ddc1e08a4d454780e551858d13d54b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:26.768073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1051/2074] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:26 2022] DELETE /identity/v3/users/632e302c613249449af5621c93ccdb4f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:26.772702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:26.772893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:26.773175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:26.783601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1024/2075] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:26 2022] DELETE /identity/v3/users/81ddc1e08a4d454780e551858d13d54b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:26.800609 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:26.802656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:26.855974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:26.926467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1052/2076] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:26.939028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:26.941369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:27.029215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e61248-853c-4d58-883a-0332d18f4397 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:27.035932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:27.037808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.038310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.038998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.054528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:27.056043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5b21-3e2d-4462-8386-1e21250d878c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:27.067446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1025/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:27.380411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:27.382632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:27.430820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863117a9-e531-4b45-962b-9b33dbd3bb3a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:27.439420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:27.441599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.441964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.442314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] PATH_INFO: `/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.444141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ec4f37a6af44ebaf1e5d0a46111370)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:27.446301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:27.552989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ec4f37a6af44ebaf1e5d0a46111370', 'request_id': 'req-fe97adb8-b64a-4d3a-9181-d27a1539ec35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.579604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ec4f37a6af44ebaf1e5d0a46111370', 'request_id': 'req-fe97adb8-b64a-4d3a-9181-d27a1539ec35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.600861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ec4f37a6af44ebaf1e5d0a46111370', 'request_id': 'req-fe97adb8-b64a-4d3a-9181-d27a1539ec35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.632118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] The token cache is being invalidate because project e5ec4f37a6af44ebaf1e5d0a46111370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:27.632118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.633180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.638262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1053/2078] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:27 2022] DELETE /identity/v3/projects/e5ec4f37a6af44ebaf1e5d0a46111370 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:27.652608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd4b-898a-410b-b4d5-44db4419968d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.653480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd4b-898a-410b-b4d5-44db4419968d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.653480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40bd4b-898a-410b-b4d5-44db4419968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.684054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:27.686156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:27.693943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6e40bd4b-898a-410b-b4d5-44db4419968d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:27.696032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6e40bd4b-898a-410b-b4d5-44db4419968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:27.725557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:27.823817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1026/2079] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:27.837139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.837422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.837596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.861149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97adb8-b64a-4d3a-9181-d27a1539ec35 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:27.863684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:27.864960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:27.869916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:27.871092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.871559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.872145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] PATH_INFO: `/v3/projects/ccbd8072857448e8b9c5b354484265a1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.874847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbd8072857448e8b9c5b354484265a1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:27.875938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1027/2080] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:27.876925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:27.881975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:27.901696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac7446-7a45-4e85-8cca-399ff655e94e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:27.910065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:27.910986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:27.911438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:27.911795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:27.912678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:27.913206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:27.915186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:27.932886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1028/2081] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:15:27.937337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:27.955264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6c89-5c70-4de6-8cab-6b31b9c6fda2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:27.978577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbd8072857448e8b9c5b354484265a1', 'request_id': 'req-8c52d22a-86df-4e02-9c19-8a94fee44921'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:27.985373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:28.002522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbd8072857448e8b9c5b354484265a1', 'request_id': 'req-8c52d22a-86df-4e02-9c19-8a94fee44921'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.010229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbd8072857448e8b9c5b354484265a1', 'request_id': 'req-8c52d22a-86df-4e02-9c19-8a94fee44921'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.032640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] The token cache is being invalidate because project ccbd8072857448e8b9c5b354484265a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:28.033130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.034101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.036310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1054/2082] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:27 2022] DELETE /identity/v3/projects/ccbd8072857448e8b9c5b354484265a1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:28.040406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.043202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:28.067352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.068568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.069154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.069439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.070245 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.075108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.134208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1029/2083] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:27 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:28.136764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.139808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:28.153250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d22a-86df-4e02-9c19-8a94fee44921 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.244363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.245927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.246332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.246965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] PATH_INFO: `/v3/users/3b7c9d0c7ea74a40bb7460f8449dd177` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.248887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7c9d0c7ea74a40bb7460f8449dd177)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.252765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.256590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a4e03-6e78-4941-9c04-8f3a92f75299 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.264212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.264843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.265121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.265396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.266056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.268114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.302562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1030/2084] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:28 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:28.309358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.325610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2904b-ba0e-444f-821b-22ee5ee2ae04 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.327048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7c9d0c7ea74a40bb7460f8449dd177'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.340004 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.340828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.341364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.341539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.342154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.344254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.350476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7c9d0c7ea74a40bb7460f8449dd177'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.351870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7c9d0c7ea74a40bb7460f8449dd177'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.353065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7c9d0c7ea74a40bb7460f8449dd177'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.366794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7c9d0c7ea74a40bb7460f8449dd177'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:28.368433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1031/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:28.374463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.377380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:28.391918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:28.401677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392b11-a0aa-4d19-885a-9bfeb64447dc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.402985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1055/2086] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:28 2022] DELETE /identity/v3/users/3b7c9d0c7ea74a40bb7460f8449dd177 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:28.503569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.504201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.504485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.504752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.505412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.507131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcbdbe-469c-48e0-bde6-b0107793da1e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.518357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1032/2087] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:28.526081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.544717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1e7a3-14a5-481c-ac91-84e8f0768fcf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.552422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.553968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.554470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.555003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] PATH_INFO: `/v3/projects/35b46eff382e4d58b7d0669075d394aa/users/fe4c8661f37f4928beb65f06cbf61436/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.562197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:28.607296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b46eff382e4d58b7d0669075d394aa, user_id=fe4c8661f37f4928beb65f06cbf61436, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.613127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.634429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1056/2088] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:28 2022] PUT /identity/v3/projects/35b46eff382e4d58b7d0669075d394aa/users/fe4c8661f37f4928beb65f06cbf61436/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:28.654638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.655467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.655467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.701767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] MFA Rules not processed for user `fe4c8661f37f4928beb65f06cbf61436`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:28.703141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:28.819391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.822065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:28.850738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1033/2089] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:28.851811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:28.929553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2d85-496f-4cb3-8f94-391482dc7560 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.935888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.936901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.937377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.937868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] PATH_INFO: `/v3/projects/87407fc583c842e595f00203349c8c83` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.939950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87407fc583c842e595f00203349c8c83)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.943656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:28.959086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f793ca8-6668-4062-b94e-8d15ad53826c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:28.966084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:28.966948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:28.967326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:28.967716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:28.968453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:28.970951 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.018771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87407fc583c842e595f00203349c8c83', 'request_id': 'req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.020267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1034/2090] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:28 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:29.021112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.026600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87407fc583c842e595f00203349c8c83', 'request_id': 'req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.034905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87407fc583c842e595f00203349c8c83', 'request_id': 'req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.050526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:29.055928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] The token cache is being invalidate because project 87407fc583c842e595f00203349c8c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:29.056414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.059126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.062541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1057/2091] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:28 2022] DELETE /identity/v3/projects/87407fc583c842e595f00203349c8c83 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:29.069228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.071990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.131470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fffbd4-d3fe-4d9a-a3e8-c58e0ee57351 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.137478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.138470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.138969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.139362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.140259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.143207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.183864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1035/2092] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:29 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:29.187787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.193058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc3e9-3937-4d15-9d02-e1d463bf166e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.201776 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.205919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.207498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.208016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.208493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] PATH_INFO: `/v3/users/5eb729543bb24458ad9aa76d382dfea4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.211755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb729543bb24458ad9aa76d382dfea4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.215073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.232565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d5949-4b25-4b3e-838a-88d142f758ed admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.241451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.241933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:29.243830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.244520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.245690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.246374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.248172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.267095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1036/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:29.268443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.280191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b0e88-229d-46ab-b2c5-5f8e266592d9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.286445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.287192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.287473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.287751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] PATH_INFO: `/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3/users/554fd697a3a949d5bf6143a18ac83208/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.296646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb729543bb24458ad9aa76d382dfea4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.317300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb729543bb24458ad9aa76d382dfea4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.318129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb729543bb24458ad9aa76d382dfea4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.318377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44eb4b2ff7b4162b0f4143e3ac3a5c3, user_id=554fd697a3a949d5bf6143a18ac83208, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.319226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb729543bb24458ad9aa76d382dfea4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.322457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.346856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb729543bb24458ad9aa76d382dfea4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.348515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1037/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:29 2022] PUT /identity/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3/users/554fd697a3a949d5bf6143a18ac83208/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:29.353905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.361623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.387011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1058/2095] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:29 2022] DELETE /identity/v3/users/5eb729543bb24458ad9aa76d382dfea4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:29.454567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35545d-81ff-4389-8343-b2b54a987099 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.534885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.536189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.536502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.536973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.537772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.539935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a0ca5-5297-4a0e-bc8b-5e1af2ecb00f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.555548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1038/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:29.559936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.570324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba438a0-0e4b-4aa8-8075-c902174463c6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.577002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.577766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.578063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.578428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] PATH_INFO: `/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3/users/554fd697a3a949d5bf6143a18ac83208/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.583343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44eb4b2ff7b4162b0f4143e3ac3a5c3, user_id=554fd697a3a949d5bf6143a18ac83208, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.583718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.610083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1059/2097] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:29 2022] PUT /identity/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3/users/554fd697a3a949d5bf6143a18ac83208/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:29.621429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.621706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.621981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.647524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:29.659142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] MFA Rules not processed for user `554fd697a3a949d5bf6143a18ac83208`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:29.661305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.773696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1039/2098] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:29.783192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.787903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.795387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:29.796891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:29.875771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7afa09-1dac-48f1-b9e3-4092d51171be admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.881052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.882120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.882289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.882574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] PATH_INFO: `/v3/projects/b946aeeb831e4d8c926f13f59fc9874b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.883800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b946aeeb831e4d8c926f13f59fc9874b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.886565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.918375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c373cd0-8aec-4957-9287-819e948544b5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:29.925650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:29.926664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:29.927239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:29.927745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:29.954973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:29.957385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:29.967291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b946aeeb831e4d8c926f13f59fc9874b', 'request_id': 'req-88c489b9-efd9-4a46-853d-00d50b06017d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.975182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1040/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:29.977965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b946aeeb831e4d8c926f13f59fc9874b', 'request_id': 'req-88c489b9-efd9-4a46-853d-00d50b06017d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:29.987208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b946aeeb831e4d8c926f13f59fc9874b', 'request_id': 'req-88c489b9-efd9-4a46-853d-00d50b06017d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.015145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] The token cache is being invalidate because project b946aeeb831e4d8c926f13f59fc9874b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:30.016283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.018097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-88c489b9-efd9-4a46-853d-00d50b06017d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.021379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1060/2100] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:29 2022] DELETE /identity/v3/projects/b946aeeb831e4d8c926f13f59fc9874b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:30.542403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:30.556193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc59ca-1ffc-4469-8ac8-34b338357158 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:30.636142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:30.636783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:30.637272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:30.637545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] PATH_INFO: `/v3/users/fe4c8661f37f4928beb65f06cbf61436` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:30.638870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4c8661f37f4928beb65f06cbf61436)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:30.641319 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:30.712908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:30.717961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4c8661f37f4928beb65f06cbf61436'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.727986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4c8661f37f4928beb65f06cbf61436'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.728673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4c8661f37f4928beb65f06cbf61436'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.729842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4c8661f37f4928beb65f06cbf61436'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.743869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4c8661f37f4928beb65f06cbf61436'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:30.772550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1041/2101] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:30 2022] DELETE /identity/v3/users/fe4c8661f37f4928beb65f06cbf61436 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:30.779403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:30.779838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:30.780322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:30.802734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:30.803996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:30.809986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:30.883945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1061/2102] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:30.897264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:30.901485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:31.020705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb64be-636a-41b2-8f82-9ddf95fac1df admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:31.024656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:31.025266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:31.025539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:31.025809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:31.036316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:31.040412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:31.049142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1042/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:31.400807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:31.403832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:31.423430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33031c8b-7ca1-410f-8c19-d263d9e5e5ba None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:31.428982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:31.429643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:31.429951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:31.430227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] PATH_INFO: `/v3/projects/35b46eff382e4d58b7d0669075d394aa` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:31.431690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b46eff382e4d58b7d0669075d394aa)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:31.433986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:31.519048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b46eff382e4d58b7d0669075d394aa', 'request_id': 'req-8605b4ee-9706-45a5-aef3-7bf469ba4314'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.531126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b46eff382e4d58b7d0669075d394aa', 'request_id': 'req-8605b4ee-9706-45a5-aef3-7bf469ba4314'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.544966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b46eff382e4d58b7d0669075d394aa', 'request_id': 'req-8605b4ee-9706-45a5-aef3-7bf469ba4314'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.564508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] The token cache is being invalidate because project 35b46eff382e4d58b7d0669075d394aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:31.564708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.565757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.567909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1062/2104] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:31 2022] DELETE /identity/v3/projects/35b46eff382e4d58b7d0669075d394aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:31.572345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:31.588057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2008a-42bd-41ce-8edd-1f152a254718 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:31.690475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:31.694256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:31.694256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:31.694256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] PATH_INFO: `/v3/users/554fd697a3a949d5bf6143a18ac83208` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:31.695346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=554fd697a3a949d5bf6143a18ac83208)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:31.699919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:31.766713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554fd697a3a949d5bf6143a18ac83208'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.777690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554fd697a3a949d5bf6143a18ac83208'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.778670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554fd697a3a949d5bf6143a18ac83208'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.779705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554fd697a3a949d5bf6143a18ac83208'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.794392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-14460e7b-8447-4ec4-bf07-335b35906f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554fd697a3a949d5bf6143a18ac83208'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:31.796174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:31.841900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1043/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:31 2022] DELETE /identity/v3/users/554fd697a3a949d5bf6143a18ac83208 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:32.223472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.225068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:32.248464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b4ee-9706-45a5-aef3-7bf469ba4314 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.318261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.319022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.319301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.319575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] PATH_INFO: `/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.320749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44eb4b2ff7b4162b0f4143e3ac3a5c3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.322729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.381664 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:32.410283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44eb4b2ff7b4162b0f4143e3ac3a5c3', 'request_id': 'req-58a04c2f-4f49-4735-8b68-ce86e60793db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:32.420507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44eb4b2ff7b4162b0f4143e3ac3a5c3', 'request_id': 'req-58a04c2f-4f49-4735-8b68-ce86e60793db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:32.429261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44eb4b2ff7b4162b0f4143e3ac3a5c3', 'request_id': 'req-58a04c2f-4f49-4735-8b68-ce86e60793db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:32.442565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] The token cache is being invalidate because project b44eb4b2ff7b4162b0f4143e3ac3a5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:32.443231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:32.444048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-58a04c2f-4f49-4735-8b68-ce86e60793db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:32.446155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1063/2106] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:32 2022] DELETE /identity/v3/projects/b44eb4b2ff7b4162b0f4143e3ac3a5c3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:32.451880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.452313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.452672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.474923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:32.476228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:32.594556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1044/2107] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:32.606531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.607045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.607532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.629833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:32.631112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:32.643903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1064/2108] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:32.648514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.661980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d97dc-32bb-4aa1-bb6f-b52231c175ef None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.667579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.668193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.668460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.668763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.669431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:32.669729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.671379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.684406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1045/2109] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:15:32.689317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.701186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e82119-4feb-4cb5-8fd5-bc352ac9847e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.706141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.706780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.707056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.707321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.707969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.709882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.740272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1065/2110] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:32 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:32.745802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.762719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ff849-7659-45c3-873f-01f9d287ca35 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.845341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.846194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.846194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.846438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.847129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.849044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.884841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1046/2111] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:32 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:32.890249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.901706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935982-1b16-4be3-b759-b8d2262fd6b4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.907929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.908838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.909292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.909750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.910869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.913716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.931475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1066/2112] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:32.937911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:32.958805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c8bb4-c9ff-4d07-8af8-eef222f041c4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:32.967689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:32.969177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:32.970028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:32.970927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:32.972441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:32.975547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110d012-073b-463f-9547-c7d077d42e37 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:32.989165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1047/2113] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:32.993452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.008249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f69b8-48e6-4230-8ea2-c75e3baabe2d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.015219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.016147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.016536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.016856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] PATH_INFO: `/v3/projects/ba550b154b5944afa1c591382453aa8b/users/8e1236f8288b4ab59f07854f6c56feb0/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.038368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba550b154b5944afa1c591382453aa8b, user_id=8e1236f8288b4ab59f07854f6c56feb0, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.044617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.061632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1067/2114] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:32 2022] PUT /identity/v3/projects/ba550b154b5944afa1c591382453aa8b/users/8e1236f8288b4ab59f07854f6c56feb0/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:33.092874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.093204 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.093431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.158197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] MFA Rules not processed for user `8e1236f8288b4ab59f07854f6c56feb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:33.160692 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:33.217377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:33.260386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1048/2115] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:33.265372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.343076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e382f4-3689-4555-b9e1-4deb75ef051f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.351052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.351805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.352249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.352617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.353422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.356323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.389866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1068/2116] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:33.394791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.413655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403685c9-9eda-43dd-b437-b63a09b86dc4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.505728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.506351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.506655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.506924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.507558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.509474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.535518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1049/2117] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:33.540815 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.555167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93a72-2e81-49d1-9cef-b7d43ae7b363 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.560119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.560732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.561010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.561289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.561941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.563604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.576063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1069/2118] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:33.580438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.592175 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeaf1d-b272-4b1d-b1c4-0f899e3c33e4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.598144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.598810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.599090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.599358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.600043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.601899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab933-cf30-416e-a066-ab132112b6a0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.613912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1050/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:33.618474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.629421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8df88-62f9-4980-b8ff-af91a3db1a84 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.634764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.636129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.636497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.636923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] PATH_INFO: `/v3/projects/cf2205c5b8d64402bd8186ed8d75bd30/users/1bcec54f34464b448e6ea9187229b542/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.655391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2205c5b8d64402bd8186ed8d75bd30, user_id=1bcec54f34464b448e6ea9187229b542, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.658257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.684186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1070/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:33 2022] PUT /identity/v3/projects/cf2205c5b8d64402bd8186ed8d75bd30/users/1bcec54f34464b448e6ea9187229b542/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:33.698389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.698389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.698389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.732835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] MFA Rules not processed for user `1bcec54f34464b448e6ea9187229b542`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:33.734916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:33.823609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1051/2121] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:33.830063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:33.845491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:33.926613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77abe3a-b701-431b-afec-10e9b8b3719f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:33.933955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:33.935079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:33.935417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:33.935936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:33.937041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:33.940094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:33.989035 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1071/2122] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:33.996226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.015697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ffb3-433a-4e18-96de-803eacefe9cb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.085084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:34.106118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.106806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.107083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.107356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.108631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.110608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.142666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1052/2123] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:33 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:34.147813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.184735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f9d9-0722-4863-af9c-15c0cbe1691c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.191890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.193364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.193549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.194209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.195220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.198916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.222133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1072/2124] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:34.228076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.243703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca32-5a89-4e32-86b7-2281cd974c4a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.262751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.262751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.262751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.262751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] PATH_INFO: `/v3/projects/bc08e27f173949c9bdafbc1db288a039/users/2cb4d46297594c9e9cce8b7980f591f7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.286142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08e27f173949c9bdafbc1db288a039, user_id=2cb4d46297594c9e9cce8b7980f591f7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.289765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.305732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1053/2125] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:34 2022] PUT /identity/v3/projects/bc08e27f173949c9bdafbc1db288a039/users/2cb4d46297594c9e9cce8b7980f591f7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:34.311003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.322887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4476af-9c64-4f0c-8090-efd0b5e34a76 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.422754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.423366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.423643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.423913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.424553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.426253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61248bb-9d84-478f-9242-338a7dafc427 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.437840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1073/2126] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:34.443114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.461206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c276-0e6e-453c-b96c-a3b44df099ff admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.469054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.470104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.470638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.471061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] PATH_INFO: `/v3/projects/bc08e27f173949c9bdafbc1db288a039/users/2cb4d46297594c9e9cce8b7980f591f7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.474202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08e27f173949c9bdafbc1db288a039, user_id=2cb4d46297594c9e9cce8b7980f591f7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.476956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.491958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1054/2127] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:34 2022] PUT /identity/v3/projects/bc08e27f173949c9bdafbc1db288a039/users/2cb4d46297594c9e9cce8b7980f591f7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:34.506780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.507188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.507554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.550174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] MFA Rules not processed for user `2cb4d46297594c9e9cce8b7980f591f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:34.551577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:34.652997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1074/2128] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:34.670546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:34.672553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:34.744873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f345fb-7907-4356-8a11-af6469315ee1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:34.748930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:34.749555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:34.749837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:34.750106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:34.831554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:34.833028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:34.844875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1055/2129] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:36.584567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:36.586767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:36.605416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596761b7-d519-4ea0-a590-d07d789f2662 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:36.609292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:36.610020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:36.610415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:36.610819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:36.616028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:36.690642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:36.699266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:36.711054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1075/2130] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:37.561769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:37.577533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9654c-8661-403d-80de-f56ccd3a0ceb service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:37.584042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:37.584827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:37.585272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:37.585751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:37.604751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:37.607526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676b25-c23c-42a3-858b-070b18766bdf service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:37.633441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1056/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:41.957150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:42.090956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d034dd-ba32-4ede-8030-e83dab46a3af service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:42.096709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:42.097553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:42.098183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:42.098473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] PATH_INFO: `/v3/users/8e1236f8288b4ab59f07854f6c56feb0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:42.099792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1236f8288b4ab59f07854f6c56feb0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:42.101773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:42.179900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1236f8288b4ab59f07854f6c56feb0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:42.192358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1236f8288b4ab59f07854f6c56feb0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:42.193044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1236f8288b4ab59f07854f6c56feb0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:42.193661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1236f8288b4ab59f07854f6c56feb0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:42.205279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1236f8288b4ab59f07854f6c56feb0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:42.242752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1076/2132] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:41 2022] DELETE /identity/v3/users/8e1236f8288b4ab59f07854f6c56feb0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:42.251011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:42.251652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:42.251889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:42.284415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:42.285800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:42.339278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:42.375530 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1057/2133] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:42.387903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:42.390594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:42.423044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:42.458916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bfe4-91c0-4d63-a592-db41e5fc61c8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:42.464869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:42.465914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:42.466400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:42.466988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:42.484297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:42.485759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:42.500577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1077/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:42.918197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:42.921002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:42.951897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb360-ead8-4e43-a8a2-5f4666daa14b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:42.960159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:42.961320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:42.961695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:42.962162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] PATH_INFO: `/v3/projects/ba550b154b5944afa1c591382453aa8b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:42.964678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba550b154b5944afa1c591382453aa8b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:42.968485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:43.045980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba550b154b5944afa1c591382453aa8b', 'request_id': 'req-67e26f88-63cb-4fef-93b1-18fe1f5967d6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.057391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba550b154b5944afa1c591382453aa8b', 'request_id': 'req-67e26f88-63cb-4fef-93b1-18fe1f5967d6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.065197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba550b154b5944afa1c591382453aa8b', 'request_id': 'req-67e26f88-63cb-4fef-93b1-18fe1f5967d6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.083088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] The token cache is being invalidate because project ba550b154b5944afa1c591382453aa8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:43.084168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.085653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.091150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1058/2135] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:42 2022] DELETE /identity/v3/projects/ba550b154b5944afa1c591382453aa8b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:43.092390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:43.108070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d7a35-68d1-467c-b22a-de0006b10e4c service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:43.198965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:43.199890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:43.200172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:43.200446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] PATH_INFO: `/v3/users/1bcec54f34464b448e6ea9187229b542` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:43.201974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcec54f34464b448e6ea9187229b542)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:43.206016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:43.278569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcec54f34464b448e6ea9187229b542'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.298049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcec54f34464b448e6ea9187229b542'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.299076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcec54f34464b448e6ea9187229b542'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.300123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcec54f34464b448e6ea9187229b542'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.312221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcec54f34464b448e6ea9187229b542'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.332147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1078/2136] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:43 2022] DELETE /identity/v3/users/1bcec54f34464b448e6ea9187229b542 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:43.756976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:43.758910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:43.772897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e26f88-63cb-4fef-93b1-18fe1f5967d6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:43.863920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:43.864558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:43.864842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:43.865108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] PATH_INFO: `/v3/projects/cf2205c5b8d64402bd8186ed8d75bd30` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:43.866422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2205c5b8d64402bd8186ed8d75bd30)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:43.868373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:43.954334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2205c5b8d64402bd8186ed8d75bd30', 'request_id': 'req-33a268a6-938e-4ed7-82e4-e689329f9c2b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.966847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2205c5b8d64402bd8186ed8d75bd30', 'request_id': 'req-33a268a6-938e-4ed7-82e4-e689329f9c2b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:43.977331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:43.990843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2205c5b8d64402bd8186ed8d75bd30', 'request_id': 'req-33a268a6-938e-4ed7-82e4-e689329f9c2b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.016991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] The token cache is being invalidate because project cf2205c5b8d64402bd8186ed8d75bd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:44.016991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.018156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.020635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1059/2137] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:43 2022] DELETE /identity/v3/projects/cf2205c5b8d64402bd8186ed8d75bd30 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:44.026843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:44.029510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:44.058856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73f617-e92c-450e-a66e-7e8ffde17735 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:44.136425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:44.173886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:44.175560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:44.176302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:44.176980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] PATH_INFO: `/v3/users/2cb4d46297594c9e9cce8b7980f591f7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:44.179377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb4d46297594c9e9cce8b7980f591f7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:44.184129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:44.291718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb4d46297594c9e9cce8b7980f591f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.316864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb4d46297594c9e9cce8b7980f591f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.318515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb4d46297594c9e9cce8b7980f591f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.320050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb4d46297594c9e9cce8b7980f591f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.347899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a394601b-c9a1-43d1-b9a7-ae848fd612d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb4d46297594c9e9cce8b7980f591f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:44.385534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1079/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:44 2022] DELETE /identity/v3/users/2cb4d46297594c9e9cce8b7980f591f7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:44.857148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:44.862751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:44.907747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a268a6-938e-4ed7-82e4-e689329f9c2b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.083534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.084498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.084879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.085196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] PATH_INFO: `/v3/projects/bc08e27f173949c9bdafbc1db288a039` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.086760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc08e27f173949c9bdafbc1db288a039)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.089396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.202846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc08e27f173949c9bdafbc1db288a039', 'request_id': 'req-f43ca281-5e86-4e6a-bd1c-4c28de90f119'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:45.218288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc08e27f173949c9bdafbc1db288a039', 'request_id': 'req-f43ca281-5e86-4e6a-bd1c-4c28de90f119'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:45.233905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc08e27f173949c9bdafbc1db288a039', 'request_id': 'req-f43ca281-5e86-4e6a-bd1c-4c28de90f119'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:45.255929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] The token cache is being invalidate because project bc08e27f173949c9bdafbc1db288a039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:45.256459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:45.257413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f43ca281-5e86-4e6a-bd1c-4c28de90f119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:45.260661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1060/2139] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:44 2022] DELETE /identity/v3/projects/bc08e27f173949c9bdafbc1db288a039 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:45.271305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.271305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.271305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.296711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:45.298199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:45.424881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1080/2140] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:45.435924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.436410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.436887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.480480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:45.482439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:45.494433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1061/2141] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:45.500506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.528219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520e952-ab86-46b6-8199-5d7223872514 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.541594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.542945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.543419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.543906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.544927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:45.545461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.548986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.576087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1081/2142] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:15:45.581723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.599502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9458-a5ba-4a51-addf-c6ce1769b22c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.613073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.613894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.614169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.615165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.615949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.618067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.670844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1062/2143] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:45.677627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.693528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192cbfb-7654-48d6-b677-1552df2a15f5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.778195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:45.798034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.799062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.799575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.800067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.801211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.804719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.832685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1082/2144] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:45 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:45.838828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.856417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e32-17e2-4661-bb42-de4f8408184f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.863340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.864396 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.864851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.865203 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.865855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.867506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.879868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1063/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:45.884127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.897441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194e07-0972-4de2-9e4b-fa3f59387f86 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.902643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.903296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.903774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.903950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.904546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.906181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbf404-e1f0-49cb-8692-167a1c50354a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:45.927576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1083/2146] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:45.934188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:45.951282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4947569-efbb-455a-b232-9605f6cf8cb8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:45.958386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:45.959308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:45.959679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:45.960036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] PATH_INFO: `/v3/projects/a984b1209b0f4f4e9b2a078be44d2212/users/092b792c735c4f07a8d664e0d14bab71/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:45.985403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a984b1209b0f4f4e9b2a078be44d2212, user_id=092b792c735c4f07a8d664e0d14bab71, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:45.988338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.006112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1064/2147] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:45 2022] PUT /identity/v3/projects/a984b1209b0f4f4e9b2a078be44d2212/users/092b792c735c4f07a8d664e0d14bab71/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:46.024472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.024960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.025840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.078021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] MFA Rules not processed for user `092b792c735c4f07a8d664e0d14bab71`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:46.080142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:46.171601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1084/2148] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:46.176935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.211905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:46.286529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b7bc-b075-4a46-bfaa-891c112483ee admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.292500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.293098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.293365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.293633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.294284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.296288 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.338680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1065/2149] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:46 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:46.342194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.362517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7bda-e316-4f18-b305-769fde0f532e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.452395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.453396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.453858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.454423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.455619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.459401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.499062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1085/2150] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:46 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:46.500463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.512284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbff77-4345-4089-bd10-2c8afcf6dbb5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.519484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.520846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.521328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.521718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.522431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.524516 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.546814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1066/2151] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:46.548902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.567055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa076-6a44-42f2-a941-ed227112c9c2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.574916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.575790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.575992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.576459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.577244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.579485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51d6b4-ddcf-4d5e-98d7-341379d3adf7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.598456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1086/2152] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:46.605745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.621317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f208-1dd4-45eb-b7c2-e43cecf1435e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.629548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.630826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.631464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.632152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] PATH_INFO: `/v3/projects/49cb11a9f27e4db1bb6b8939c61de1b2/users/47ced45d5d754985abdb0ee14de34894/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.659741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cb11a9f27e4db1bb6b8939c61de1b2, user_id=47ced45d5d754985abdb0ee14de34894, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.662469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:46.679714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1067/2153] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:46 2022] PUT /identity/v3/projects/49cb11a9f27e4db1bb6b8939c61de1b2/users/47ced45d5d754985abdb0ee14de34894/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:46.692483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.693043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.693460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.737628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] MFA Rules not processed for user `47ced45d5d754985abdb0ee14de34894`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:46.739819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:46.793880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:46.857743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1087/2154] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:46.863426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:46.967602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093828c2-7beb-4873-a7ac-9712f7ad223c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:46.975198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:46.976394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:46.977178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:46.977701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:46.979449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:46.983186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.031075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1068/2155] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:46 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:47.039545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.059877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e95556-2bdf-415c-ab45-d2b3859eb944 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.181949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.182849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.183173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.183614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.184462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:47.187054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.220467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1088/2156] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:47 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:47.225469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.242330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f293-d74c-40d0-b7da-3414446bcc2c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.249804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.251534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.252016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.252498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.253893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:47.258413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.280214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1069/2157] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:47.285206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.303527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2eb9-f4f1-42a6-94d3-aff0f403c10c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.315797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.317038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.317555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.318131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] PATH_INFO: `/v3/projects/0f29c4a14af142f194fe240548333a10/users/0508a202d1894fb9987822a256b63a14/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.370379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f29c4a14af142f194fe240548333a10, user_id=0508a202d1894fb9987822a256b63a14, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:47.376037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.405820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1089/2158] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:47 2022] PUT /identity/v3/projects/0f29c4a14af142f194fe240548333a10/users/0508a202d1894fb9987822a256b63a14/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:47.411328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.424514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21132c97-d743-4ef3-b5a9-3bb085a1aa77 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.500584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:47.535578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.536636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.537153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.537623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.538860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:47.542266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bc8e3-0019-4f6a-b016-d58aab3642ca admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.570954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1070/2159] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:47.574533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.591240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8dac-fb04-4cff-86ec-744e9fe8f5de admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.604278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.604755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.606540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.606540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] PATH_INFO: `/v3/projects/0f29c4a14af142f194fe240548333a10/users/0508a202d1894fb9987822a256b63a14/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.613639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f29c4a14af142f194fe240548333a10, user_id=0508a202d1894fb9987822a256b63a14, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:47.617753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:47.642467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1090/2160] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:47 2022] PUT /identity/v3/projects/0f29c4a14af142f194fe240548333a10/users/0508a202d1894fb9987822a256b63a14/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:47.658336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.658869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.659749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:47.714132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] MFA Rules not processed for user `0508a202d1894fb9987822a256b63a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:47.716365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:47.858126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1071/2161] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:47.876113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:47.878546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:47.964794 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1a4c-8dee-4bab-8e20-a1aef94d69d0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:47.968975 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:47.969611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:47.969906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:47.970312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:48.016908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:48.052477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:48.053931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:48.064687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1091/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:49.835209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:49.838627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:49.853834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba689a-5ed9-4d4d-bf50-4ea32c5177d4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:49.857630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:49.858246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:49.858766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:49.859185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:49.869267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:49.871168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:49.956550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:49.959797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8abd9-2c6b-4d09-be2a-1b05199af2cd service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:49.982075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1072/2163] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:49.987910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a289-03b8-4615-8243-23815aec10b7 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:49.997879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:49.999060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:49.999560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:50.000061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] PATH_INFO: `/v3/users/915617522e474440964bb47ba74408fe` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:50.002109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=915617522e474440964bb47ba74408fe)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:50.005973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:50.098519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915617522e474440964bb47ba74408fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.108768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915617522e474440964bb47ba74408fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.109601 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915617522e474440964bb47ba74408fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.110445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915617522e474440964bb47ba74408fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.122227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915617522e474440964bb47ba74408fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.143580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1092/2164] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:49 2022] DELETE /identity/v3/users/915617522e474440964bb47ba74408fe => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:50.149940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:50.151039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:50.151039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:50.175611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:50.177535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:50.269490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1073/2165] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:15:50.281047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:50.282647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:50.365219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeecf9-c28c-4cc0-91cf-04895e8ced5f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:50.370934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:50.371651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:50.372025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:50.372340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:50.386078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:50.388637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:50.395062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:50.408098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1093/2166] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:50.769223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:50.770834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:50.777191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:50.846293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a45d47-d66a-4c7a-9c00-571668116f24 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:50.852665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:50.853476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:50.853809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:50.853986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:50.854151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:50.856306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:50.856649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:50.879553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8c197-d12e-4c7b-84c6-82ca3dd20ce1 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:50.888479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:50.889758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:50.889758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:50.889981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] PATH_INFO: `/v3/projects/7f4e7b39d9dd424e890ddab0c1e6e0f0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:50.891933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4e7b39d9dd424e890ddab0c1e6e0f0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:50.894276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:50.955974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:50.958559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:50.965730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4e7b39d9dd424e890ddab0c1e6e0f0', 'request_id': 'req-484e0c54-20d8-41a7-81bf-936f70966ce3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.972829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1074/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:15:50.976177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4e7b39d9dd424e890ddab0c1e6e0f0', 'request_id': 'req-484e0c54-20d8-41a7-81bf-936f70966ce3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:50.984838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4e7b39d9dd424e890ddab0c1e6e0f0', 'request_id': 'req-484e0c54-20d8-41a7-81bf-936f70966ce3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:51.010040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] The token cache is being invalidate because project 7f4e7b39d9dd424e890ddab0c1e6e0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:51.010566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:51.011573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-484e0c54-20d8-41a7-81bf-936f70966ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:51.027716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1094/2168] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:50 2022] DELETE /identity/v3/projects/7f4e7b39d9dd424e890ddab0c1e6e0f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:55.275832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:55.277576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:55.292764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feed55-d788-4b0f-b58b-d8245d5b239f service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:55.360142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:55.360972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:55.361483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:55.361944 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] PATH_INFO: `/v3/users/092b792c735c4f07a8d664e0d14bab71` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:55.363911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092b792c735c4f07a8d664e0d14bab71)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:55.366019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:55.424323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092b792c735c4f07a8d664e0d14bab71'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:55.433073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092b792c735c4f07a8d664e0d14bab71'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:55.434093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092b792c735c4f07a8d664e0d14bab71'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:55.434898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092b792c735c4f07a8d664e0d14bab71'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:55.436768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:55.449571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092b792c735c4f07a8d664e0d14bab71'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:55.481021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1075/2169] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:55 2022] DELETE /identity/v3/users/092b792c735c4f07a8d664e0d14bab71 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:55.488287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:55.488796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:55.489239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:55.520783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:55.522040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:55.591226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1095/2170] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:55.604586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:55.606714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:55.675073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf543-7f72-42db-a35e-163eb8227737 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:55.678743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:55.679355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:55.679626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:55.679894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:55.690923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:55.692800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:55.703988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1076/2171] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:56.044468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:56.046199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:56.059888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665ca0-c4ab-41f4-bb8c-1aeddeeaf1b1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:56.065843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:56.066887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:56.067208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:56.067675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] PATH_INFO: `/v3/projects/a984b1209b0f4f4e9b2a078be44d2212` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:56.069721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a984b1209b0f4f4e9b2a078be44d2212)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:56.072989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:56.139718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a984b1209b0f4f4e9b2a078be44d2212', 'request_id': 'req-947b49f8-7516-401d-b456-39e23098deee'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.149711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a984b1209b0f4f4e9b2a078be44d2212', 'request_id': 'req-947b49f8-7516-401d-b456-39e23098deee'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.160186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a984b1209b0f4f4e9b2a078be44d2212', 'request_id': 'req-947b49f8-7516-401d-b456-39e23098deee'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.180541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] The token cache is being invalidate because project a984b1209b0f4f4e9b2a078be44d2212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:56.180811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.182296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.184465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1096/2172] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:56 2022] DELETE /identity/v3/projects/a984b1209b0f4f4e9b2a078be44d2212 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:15:56.190785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:56.204726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff05be-276d-4d63-9cf3-c028ec5439dd service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:56.276249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:56.277303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:56.277303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:56.277618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] PATH_INFO: `/v3/users/47ced45d5d754985abdb0ee14de34894` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:56.279144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ced45d5d754985abdb0ee14de34894)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:56.283073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:56.348220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ced45d5d754985abdb0ee14de34894'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.357553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ced45d5d754985abdb0ee14de34894'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.358252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ced45d5d754985abdb0ee14de34894'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.358884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ced45d5d754985abdb0ee14de34894'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.368495 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ced45d5d754985abdb0ee14de34894'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:56.381541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:56.397105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1077/2173] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:56 2022] DELETE /identity/v3/users/47ced45d5d754985abdb0ee14de34894 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:56.791326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:56.793861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:56.810744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:56.818765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b49f8-7516-401d-b456-39e23098deee admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:56.914478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:56.915682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:56.916137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:56.916599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] PATH_INFO: `/v3/projects/49cb11a9f27e4db1bb6b8939c61de1b2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:56.918870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cb11a9f27e4db1bb6b8939c61de1b2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:56.922610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:57.010173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cb11a9f27e4db1bb6b8939c61de1b2', 'request_id': 'req-45760983-2f51-4c4b-8b7e-69c11f7a3a16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.025346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cb11a9f27e4db1bb6b8939c61de1b2', 'request_id': 'req-45760983-2f51-4c4b-8b7e-69c11f7a3a16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.040619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cb11a9f27e4db1bb6b8939c61de1b2', 'request_id': 'req-45760983-2f51-4c4b-8b7e-69c11f7a3a16'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.054666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] The token cache is being invalidate because project 49cb11a9f27e4db1bb6b8939c61de1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:57.054965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.055629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.057554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1097/2174] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:56 2022] DELETE /identity/v3/projects/49cb11a9f27e4db1bb6b8939c61de1b2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:57.069127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:57.071025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:57.090299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216a07-f20f-4d7c-88e5-3532618c8c2a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:57.170563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:57.171229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:57.171498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:57.171771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] PATH_INFO: `/v3/users/0508a202d1894fb9987822a256b63a14` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:57.173012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0508a202d1894fb9987822a256b63a14)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:57.175438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:57.257063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0508a202d1894fb9987822a256b63a14'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.269508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0508a202d1894fb9987822a256b63a14'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.270464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0508a202d1894fb9987822a256b63a14'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.271445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0508a202d1894fb9987822a256b63a14'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.284360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19928a1-289b-48b2-9144-0f1f1514f0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0508a202d1894fb9987822a256b63a14'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.311891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1078/2175] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:15:57 2022] DELETE /identity/v3/users/0508a202d1894fb9987822a256b63a14 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:57.779749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:57.782041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:57.807834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760983-2f51-4c4b-8b7e-69c11f7a3a16 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:57.898871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:57.899773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:57.900676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:57.901060 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] PATH_INFO: `/v3/projects/0f29c4a14af142f194fe240548333a10` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:57.902763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f29c4a14af142f194fe240548333a10)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:57.905017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:57.948342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:57.961830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f29c4a14af142f194fe240548333a10', 'request_id': 'req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.971304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f29c4a14af142f194fe240548333a10', 'request_id': 'req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.979445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f29c4a14af142f194fe240548333a10', 'request_id': 'req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.993909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] The token cache is being invalidate because project 0f29c4a14af142f194fe240548333a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:15:57.994191 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.994881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f6e9cb-1fcd-410b-9b42-231bc5b7530a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:15:57.996403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1098/2176] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:15:57 2022] DELETE /identity/v3/projects/0f29c4a14af142f194fe240548333a10 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:58.006133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.006721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.008140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.033459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:58.034459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:58.124680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1079/2177] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:58.137149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.137491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.137874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.162318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:58.164473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:58.177691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1099/2178] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:58.184707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.197652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53553-e27c-4ecc-a5a5-308e458a45fa None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.204829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.205448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.205723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.205996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.206690 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:15:58.206994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.208609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.219724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:15:58.225797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1080/2179] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:15:58.232261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.244652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ebaf8-542e-44e5-922f-517bb7b51fa7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.254348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.255221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.255643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.256054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.257025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.260872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.307956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1100/2180] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:15:58 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:15:58.314649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.328365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15eccc-5387-4c83-ba0a-a86bd03d3734 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.415699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.417009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.417509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.417877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.418793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.421038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.450241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1081/2181] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:15:58 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:15:58.455138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.465950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1205-331a-4f26-a540-d50a6c6781e4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.470795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.471385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.471656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.471922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.472554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.474136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.485939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1101/2182] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:15:58.491305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.502888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad51a9-8911-493b-af82-175aca56736b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.508030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.508640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.508924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.509199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.509844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.511485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b3f9-e83d-4628-aa7c-f5f4cfec1a12 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.523211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1082/2183] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:15:58.527725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.539396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ac21-2a75-4bb4-ab8f-880a010ad34c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.545246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.545903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.546180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.546454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] PATH_INFO: `/v3/projects/77ff27c50d6246d1bda62d1f2977b40d/users/988f82551b5e4225bb0b62badda1e4fc/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.567852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ff27c50d6246d1bda62d1f2977b40d, user_id=988f82551b5e4225bb0b62badda1e4fc, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.573213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.597106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1102/2184] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:15:58 2022] PUT /identity/v3/projects/77ff27c50d6246d1bda62d1f2977b40d/users/988f82551b5e4225bb0b62badda1e4fc/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:15:58.605625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86cb-08ca-4170-9056-3a468c41953d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.606132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86cb-08ca-4170-9056-3a468c41953d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.606684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86cb-08ca-4170-9056-3a468c41953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.635594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-bb6f86cb-08ca-4170-9056-3a468c41953d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:58.637649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bb6f86cb-08ca-4170-9056-3a468c41953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:58.752218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1083/2185] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:15:58.764952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:15:58.767838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:15:58.871265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258ebaa-d9f3-475a-81f1-9ac780843664 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:15:58.877403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:15:58.878337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:58.879518 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:58.879994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:58.897172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:15:58.899278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:15:58.917330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1103/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:15:59.911721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd48-6bf2-47ca-a1bf-4daaa58039c2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:15:59.912488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd48-6bf2-47ca-a1bf-4daaa58039c2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:15:59.912729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd48-6bf2-47ca-a1bf-4daaa58039c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:15:59.963200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9678fd48-6bf2-47ca-a1bf-4daaa58039c2 None None] MFA Rules not processed for user `988f82551b5e4225bb0b62badda1e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:15:59.965174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9678fd48-6bf2-47ca-a1bf-4daaa58039c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:00.079438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1084/2187] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:00.097153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:00.104132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:00.287512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2bd82-52b4-4b41-8a94-50c4bc6fc5f5 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:00.297745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:00.298688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:00.299069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:00.299516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:00.313222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:00.316146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:00.338909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1104/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:16:01.857496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94458-cb08-4bd1-ae93-f6ba2f1ebfdf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:01.866584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94458-cb08-4bd1-ae93-f6ba2f1ebfdf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:01.867450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94458-cb08-4bd1-ae93-f6ba2f1ebfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:01.908139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-daf94458-cb08-4bd1-ae93-f6ba2f1ebfdf None None] MFA Rules not processed for user `988f82551b5e4225bb0b62badda1e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:01.909542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-daf94458-cb08-4bd1-ae93-f6ba2f1ebfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:01.919161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1085/2189] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:04.165313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:04.168347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:04.192114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f4e4-1a05-405b-a034-947c19ad8ae5 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:04.202570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:04.203622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:04.204138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:04.204507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] PATH_INFO: `/v3/users/291c2f162e3647c9a70920566fa7120d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:04.206696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291c2f162e3647c9a70920566fa7120d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:04.209771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:04.212651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:04.289837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291c2f162e3647c9a70920566fa7120d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:04.310300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291c2f162e3647c9a70920566fa7120d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:04.311314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291c2f162e3647c9a70920566fa7120d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:04.312311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291c2f162e3647c9a70920566fa7120d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:04.327410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291c2f162e3647c9a70920566fa7120d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:04.356269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1105/2190] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:16:04 2022] DELETE /identity/v3/users/291c2f162e3647c9a70920566fa7120d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:04.363231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:04.363868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:04.364182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:04.377448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:04.397840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:04.399253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:04.483935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1086/2191] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:04.494755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:04.496529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:04.570206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b80a3-69f4-4130-8b03-0b3458487aa5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:04.574074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:04.574710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:04.575078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:04.575353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:04.586867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:04.589742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea8dc0-92c4-45c8-b2a5-d42a71dad286 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:04.612386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1106/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:16:04.956555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:04.958712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:05.005551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3804a-e552-47ca-8374-9576feb18436 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.014384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.015230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.015799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.016670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] PATH_INFO: `/v3/projects/3680ff0d869146beb3e747ced5a1108d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.019787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3680ff0d869146beb3e747ced5a1108d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.023748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.116198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3680ff0d869146beb3e747ced5a1108d', 'request_id': 'req-9e7f2d82-0220-4f77-8ec8-b234381620b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:05.127818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3680ff0d869146beb3e747ced5a1108d', 'request_id': 'req-9e7f2d82-0220-4f77-8ec8-b234381620b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:05.135715 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3680ff0d869146beb3e747ced5a1108d', 'request_id': 'req-9e7f2d82-0220-4f77-8ec8-b234381620b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:05.150356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] The token cache is being invalidate because project 3680ff0d869146beb3e747ced5a1108d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:16:05.150876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:05.152093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9e7f2d82-0220-4f77-8ec8-b234381620b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:05.154169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1087/2193] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:16:04 2022] DELETE /identity/v3/projects/3680ff0d869146beb3e747ced5a1108d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:05.159938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.160243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.160544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.192057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:05.194095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:05.270959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1107/2194] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:05.280867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.281369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.281857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.306895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:05.308192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:05.316753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1088/2195] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:05.321613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.338636 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9328cc4-ec60-47bb-8d4d-b6f1794710f2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.346129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.347165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.347471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.347745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.348454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:16:05.348687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.350540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.364492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1108/2196] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:16:05.369678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.379431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fef17-0880-4d8b-842d-8debf76d7027 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.384601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.385267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.385542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.385810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.386456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.388939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.434619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1089/2197] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:16:05 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:16:05.435833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.452835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177522b-61de-45ed-b323-c3d267a9067c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.461494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:05.540688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.541915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.542584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.543074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.544439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.548124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.604517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1109/2198] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:16:05 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:16:05.609584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.629108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02008c-db4b-4fa3-bc22-1c8e1e64cabb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.639300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.640262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.640537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.640811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.641471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.643165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.667232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1090/2199] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:16:05.668747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.689876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed2b7b-a1ef-4965-ad34-691951dc1edb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.700552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.701860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.702673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.703568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.704637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.707939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b88c90-8d52-456d-9291-e9bc085cd9a7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.734240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1110/2200] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:05.738331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:05.761292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851df5ae-1786-4b81-b25d-e67c218128ae admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:05.773308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:05.774061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.775066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.776234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] PATH_INFO: `/v3/projects/1af4b2879ac4420cba304969498aadf7/users/71e4aa084b5141aebe41a637ed183ccd/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.809420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af4b2879ac4420cba304969498aadf7, user_id=71e4aa084b5141aebe41a637ed183ccd, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:05.812728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:05.839604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1091/2201] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:16:05 2022] PUT /identity/v3/projects/1af4b2879ac4420cba304969498aadf7/users/71e4aa084b5141aebe41a637ed183ccd/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:16:05.852705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956164e7-e89f-4a2c-aaea-34c9672b1a37 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:05.853167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956164e7-e89f-4a2c-aaea-34c9672b1a37 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:05.853303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956164e7-e89f-4a2c-aaea-34c9672b1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:05.902232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-956164e7-e89f-4a2c-aaea-34c9672b1a37 None None] MFA Rules not processed for user `71e4aa084b5141aebe41a637ed183ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:05.904491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-956164e7-e89f-4a2c-aaea-34c9672b1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:06.042387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1111/2202] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:06.072761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:06.076257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:06.115168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:06.171528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ffb32-e889-4907-b5bf-ced79a07a7a0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:06.186868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:06.186868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:06.188941 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:06.189567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:06.217259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:06.220334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:06.244367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1092/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:16:08.769795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccc80-e223-4259-b052-acca002807cb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:08.770346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccc80-e223-4259-b052-acca002807cb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:08.770654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccc80-e223-4259-b052-acca002807cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:08.825477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b02ccc80-e223-4259-b052-acca002807cb None None] MFA Rules not processed for user `a11490d644a6482689eb26dd6fe965dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:08.826795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b02ccc80-e223-4259-b052-acca002807cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:08.916300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1112/2204] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:09.318166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:09.440326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf8af-76b4-4cfb-bd41-c57335701493 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:09.448407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:09.449074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:09.449352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:09.449623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] PATH_INFO: `/v3/users/71e4aa084b5141aebe41a637ed183ccd` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:09.450890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e4aa084b5141aebe41a637ed183ccd)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:09.452943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:09.528268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e4aa084b5141aebe41a637ed183ccd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:09.543015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e4aa084b5141aebe41a637ed183ccd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:09.544188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e4aa084b5141aebe41a637ed183ccd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:09.545152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e4aa084b5141aebe41a637ed183ccd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:09.562696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e4aa084b5141aebe41a637ed183ccd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:09.594959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1093/2205] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:16:09 2022] DELETE /identity/v3/users/71e4aa084b5141aebe41a637ed183ccd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:09.599992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:09.600407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:09.601826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:09.629227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:09.630193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:09.658369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:09.764872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1113/2206] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:09.776296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:09.782085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:09.894844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:09.934982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd279a-a55e-4b06-950f-ace5b756784a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:09.950361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:09.951580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:09.951875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:09.952152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:09.971259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:09.974721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0442a-670c-4338-a285-a74ae0adc88d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:09.998829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1094/2207] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:16:10.591078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:10.592610 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:10.618955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eb1c8-8d3c-41a7-9976-3a4a4f1d46c9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:10.624750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:10.626521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:10.627043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:10.627533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] PATH_INFO: `/v3/projects/1af4b2879ac4420cba304969498aadf7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:10.629050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af4b2879ac4420cba304969498aadf7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:10.631790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:10.752889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af4b2879ac4420cba304969498aadf7', 'request_id': 'req-cf067996-4192-48c0-86e9-d3122ca3f7a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:10.766822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af4b2879ac4420cba304969498aadf7', 'request_id': 'req-cf067996-4192-48c0-86e9-d3122ca3f7a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:10.775661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af4b2879ac4420cba304969498aadf7', 'request_id': 'req-cf067996-4192-48c0-86e9-d3122ca3f7a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:10.789470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] The token cache is being invalidate because project 1af4b2879ac4420cba304969498aadf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:16:10.790335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:10.791070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf067996-4192-48c0-86e9-d3122ca3f7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:10.792852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1114/2208] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:16:10 2022] DELETE /identity/v3/projects/1af4b2879ac4420cba304969498aadf7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:10.800225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:10.801052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:10.801208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:10.838337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:10.839659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:10.921441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1095/2209] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:10.930960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:10.931247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:10.931520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:10.952897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:10.954220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:10.971108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1115/2210] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:10.980416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:10.992892 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd70b1-d178-4983-92be-672b590971dc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:10.998273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:10.998945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:10.999401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:10.999673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.000327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:16:11.000625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.002246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.015787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1096/2211] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:16:11.020840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.033414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd47e-74c3-4a5f-9593-d1317b2392ef None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.039540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.040715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.041182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.041708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.042376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.044625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.083069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1116/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:16:11 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:16:11.089082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.106911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154553a4-6efa-4cb1-a33d-b9992184f6e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.195210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.196299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.196580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.196858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.197685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.200104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.248602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1097/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:16:11 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:16:11.250702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.268714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdabbe-0542-498d-ba9b-e61d6b79ecca admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.275113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.275786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.276100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.276417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.277247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.280007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.292422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1117/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:11.297461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.311011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c60204-0968-4201-8e6d-b531fda18a07 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.316503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.317162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.317378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.317657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.318301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.319966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818887-b5ae-4059-8a5b-7428c082b71e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.332757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1098/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:11.339443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.351155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dd3e-7a83-44cc-81b3-836a3925258c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.360006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.366322 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.366919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.367424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] PATH_INFO: `/v3/projects/3efefaede94e49b8b062ab8a014ee70e/users/6549e41b6dbc4480906f8f7e94eb71a3/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.390389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efefaede94e49b8b062ab8a014ee70e, user_id=6549e41b6dbc4480906f8f7e94eb71a3, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.393617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.433948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1118/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:16:11 2022] PUT /identity/v3/projects/3efefaede94e49b8b062ab8a014ee70e/users/6549e41b6dbc4480906f8f7e94eb71a3/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:11.438946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.439229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.439508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.496287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] MFA Rules not processed for user `6549e41b6dbc4480906f8f7e94eb71a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:11.498397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:11.579059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:11.613144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1099/2217] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:11.629644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:11.632861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:11.686914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:11.702625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd445b-0fe6-424d-be5a-7fd85718ff46 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:11.708551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:11.710434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:11.710939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:11.714126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:11.725487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:11.726978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa6c66-da8f-493c-8957-58cc3e686255 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:11.738306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1119/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:16:17.131860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:17.216551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc58aa-8bff-4603-bcd3-302addfcf80e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:17.221244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:17.221875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:17.222148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:17.222421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] PATH_INFO: `/v3/users/6549e41b6dbc4480906f8f7e94eb71a3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:17.223636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6549e41b6dbc4480906f8f7e94eb71a3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:17.225579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:17.286580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6549e41b6dbc4480906f8f7e94eb71a3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:17.296337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6549e41b6dbc4480906f8f7e94eb71a3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:17.297205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6549e41b6dbc4480906f8f7e94eb71a3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:17.297910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6549e41b6dbc4480906f8f7e94eb71a3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:17.309029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6549e41b6dbc4480906f8f7e94eb71a3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:17.333147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1100/2219] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:16:17 2022] DELETE /identity/v3/users/6549e41b6dbc4480906f8f7e94eb71a3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:17.338663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:17.339288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:17.339408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:17.360580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:17.361811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:17.459773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1120/2220] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:17.469989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:17.471448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:17.558878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb8ea-1549-4652-8e1c-b0c27a33cf36 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:17.563473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:17.564156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:17.564435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:17.564709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:17.581246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:17.583003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29036-03f1-47cf-bfd4-6ea728f0089d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:17.595774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1101/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:16:17.987375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:17.989367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:18.029101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590ea55-0b0b-478b-8532-71fab50ec12e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.047389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.048871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.049692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.051520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] PATH_INFO: `/v3/projects/3efefaede94e49b8b062ab8a014ee70e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.054456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efefaede94e49b8b062ab8a014ee70e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.064786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.176667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efefaede94e49b8b062ab8a014ee70e', 'request_id': 'req-f1cbb08d-a821-40f8-be25-f7bf23a24813'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:18.195210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efefaede94e49b8b062ab8a014ee70e', 'request_id': 'req-f1cbb08d-a821-40f8-be25-f7bf23a24813'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:18.219101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efefaede94e49b8b062ab8a014ee70e', 'request_id': 'req-f1cbb08d-a821-40f8-be25-f7bf23a24813'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:18.266834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] The token cache is being invalidate because project 3efefaede94e49b8b062ab8a014ee70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:16:18.267315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:18.268476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f1cbb08d-a821-40f8-be25-f7bf23a24813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:16:18.271344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1121/2222] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:16:17 2022] DELETE /identity/v3/projects/3efefaede94e49b8b062ab8a014ee70e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:18.284111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.284891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.285439 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.300464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:18.326584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:18.333489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:18.479886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1102/2223] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:18.488976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.489538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.489685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.517511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:18.519422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:18.530786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1122/2224] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:18.534380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:18.545911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a429d-95f9-45c1-b31e-873ff5661166 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.551495 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.552258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.553845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.553845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.553845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:16:18.554317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.559658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.583373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1103/2225] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:16:18.589398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:18.599336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca915d-f1bf-46fb-abbe-d40ff08c203a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.608870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.609721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.610197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.610714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.611598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.614494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.656775 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1123/2226] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:16:18 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:16:18.661745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:18.678795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df2a13-8bcc-4059-9b52-f4bcbe9dfda9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.810851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.811635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.812030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.812440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.813327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.815502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.845647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1104/2227] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:16:18 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:16:18.852474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:18.881673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e2ce7-b623-4351-8017-5de11f9caa15 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.892770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.894309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.894925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.895503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.896786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.900037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.940096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1124/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:18.942179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:18.958863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586d6af-0c3f-4ec0-a303-8a83b705f5fd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:18.966279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:18.967194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:18.967762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:18.968214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:18.969345 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:18.971591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e0ce2-45bf-4237-972c-02c6774a1768 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:18.994085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1105/2229] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:16:18.999306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:19.030144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa1b2-fc3a-4720-b63d-6e8809b918a6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:19.043381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:19.044429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:19.044877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:19.045324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] PATH_INFO: `/v3/projects/4299cfa8307c45a8894057654b1b7dfb/users/6d9a94869c5e434ea030773e74cf301b/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:19.083910 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4299cfa8307c45a8894057654b1b7dfb, user_id=6d9a94869c5e434ea030773e74cf301b, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:19.089650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:19.127306 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1125/2230] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:16:18 2022] PUT /identity/v3/projects/4299cfa8307c45a8894057654b1b7dfb/users/6d9a94869c5e434ea030773e74cf301b/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:19.139242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc92b-de08-4e9c-a731-e51c1a651cd6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:19.139785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc92b-de08-4e9c-a731-e51c1a651cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:19.141122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc92b-de08-4e9c-a731-e51c1a651cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:19.179105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e3afc92b-de08-4e9c-a731-e51c1a651cd6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:19.181519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e3afc92b-de08-4e9c-a731-e51c1a651cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:19.347198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1106/2231] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:19.353882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:19.355679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:19.362394 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:19.441646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3c9d-6c38-4912-873d-8ae6bba86ae7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:19.457552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:19.458041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:19.458552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:19.459043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:19.470520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:19.471995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91af48b-d0ab-4e30-81ad-7b44e351b009 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:19.494630 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1126/2232] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:16:24.262064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:24.262574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:24.262770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:24.292716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] MFA Rules not processed for user `dd8269c9310d457ab007d0beec62f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:24.296104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:24.317458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:24.449511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1107/2233] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:26.439339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:26.440354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:26.440836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:26.495082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] MFA Rules not processed for user `6d9a94869c5e434ea030773e74cf301b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:26.497236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:26.704182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1127/2234] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:26.705834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:26.723602 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126baca-3c1e-4d21-8ee9-8de9e08828b1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:26.734261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:26.734924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:26.735534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:26.736184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:26.737018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:26.747394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:26.808094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1108/2235] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:16:26 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:16:26.812302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:26.824352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b77c1-571a-45ed-9970-0a1313c42b15 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:26.964985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:26.966157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:26.966728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:26.968435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:26.969611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:26.972667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:27.030113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1128/2236] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:16:26 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:16:27.034472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:27.052190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486605af-63bb-4d49-9a7d-a3cb86b1c14f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:27.068269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:27.069104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:27.069619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:27.069989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:27.071584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:27.073462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:27.099146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1109/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:27.100821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:27.120644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b38f-fcc8-40c8-b235-3b6c22811f3d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:27.130240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:27.139729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:27.140067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:27.140459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] PATH_INFO: `/v3/projects/11554daef1aa41c6b4a8100182a8ca9d/users/774fcc8e904a489b8037621be4aeddec/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:27.178785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11554daef1aa41c6b4a8100182a8ca9d, user_id=774fcc8e904a489b8037621be4aeddec, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:27.183769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:27.213323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1129/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:16:27 2022] PUT /identity/v3/projects/11554daef1aa41c6b4a8100182a8ca9d/users/774fcc8e904a489b8037621be4aeddec/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:27.218339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:27.230080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08295a91-35c8-42fd-95b3-78d73989f79f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:27.345742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:27.346840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:27.347292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:27.347658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:27.348434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:27.352806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644889bb-89a9-4565-99af-be01b24f672c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:27.379226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1110/2239] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:16:27.385916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:27.396258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:27.410259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe509-a09c-4509-8233-9f84d1473ee6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:27.424115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:27.425197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:27.425608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:27.426083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] PATH_INFO: `/v3/projects/11554daef1aa41c6b4a8100182a8ca9d/users/774fcc8e904a489b8037621be4aeddec/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:27.433947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11554daef1aa41c6b4a8100182a8ca9d, user_id=774fcc8e904a489b8037621be4aeddec, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:27.441192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3a51-c7fd-4550-9f96-3216c7a940e3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:27.466617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1130/2240] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:16:27 2022] PUT /identity/v3/projects/11554daef1aa41c6b4a8100182a8ca9d/users/774fcc8e904a489b8037621be4aeddec/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:16:32.399272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:32.407412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:32.408476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:32.474338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] MFA Rules not processed for user `988f82551b5e4225bb0b62badda1e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:32.475931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:32.576239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1111/2241] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:35.267845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbf8f0-60c9-4ea5-bfb5-f95340c2df7d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:35.271170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbf8f0-60c9-4ea5-bfb5-f95340c2df7d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:35.272157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbf8f0-60c9-4ea5-bfb5-f95340c2df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:35.338138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1fdbf8f0-60c9-4ea5-bfb5-f95340c2df7d None None] MFA Rules not processed for user `774fcc8e904a489b8037621be4aeddec`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:35.339726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1fdbf8f0-60c9-4ea5-bfb5-f95340c2df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:35.533002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1131/2242] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:35.549664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:35.551835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:35.600274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:35.650362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85854805-667c-4eee-a145-c9eb38f85900 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:35.669188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:35.672024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:35.675351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:35.676163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:35.842618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:35.845229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:35.884171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1112/2243] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:16:36.282768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0354c-3691-4885-93b4-34e436d601c9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:36.283544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0354c-3691-4885-93b4-34e436d601c9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:36.283544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0354c-3691-4885-93b4-34e436d601c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:36.331846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-77d0354c-3691-4885-93b4-34e436d601c9 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:36.333092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-77d0354c-3691-4885-93b4-34e436d601c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:36.476953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1132/2244] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:16:36.617682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:36.620176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:36.941095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2656e64-9466-48af-b799-90e8bb1350d8 service glance] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:36.984681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:36.986656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:36.987336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:36.987811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:37.000559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:37.007841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:37.052227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1113/2245] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:16:40.482579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:40.483413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:40.483413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:40.535304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:40.538211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:40.588656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1133/2246] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:16:40.603912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:40.642051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6412d5-10fc-4e42-bdb8-025621e1a816 service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:40.664200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:40.666531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:40.668706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:40.669077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:40.735344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:40.735344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d63b8-55b2-476d-9691-b04c57f1ef09 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:40.745167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1114/2247] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:16:42.856143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:16:42.859510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:43.194265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29137c-61f1-4a10-90c1-46e9540529b3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:16:43.221652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:16:43.223318 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:43.224126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:43.226264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:43.236357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:43.284421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:16:43.289857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6e351-0c62-4ddf-8612-eea30da385d6 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:16:43.331085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1134/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:16:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:16:50.738510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=75 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:53.322697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:16:58.119242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:16:58.120123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:16:58.120976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:16:58.188531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] MFA Rules not processed for user `6d9a94869c5e434ea030773e74cf301b`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:16:58.191289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:16:58.202870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1115/2249] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:06.429112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7edb-36ab-4c68-a95f-8b45fd81db78 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:06.432381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7edb-36ab-4c68-a95f-8b45fd81db78 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:06.432381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7edb-36ab-4c68-a95f-8b45fd81db78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:06.452236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e6bf7edb-36ab-4c68-a95f-8b45fd81db78 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:06.453727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6bf7edb-36ab-4c68-a95f-8b45fd81db78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:06.462876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1135/2250] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:06.480323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:06.505031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe7419-c18b-4103-b290-6ca8f7b739b6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:06.519261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:06.521820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:06.522039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:06.522339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:06.535093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:06.535093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062854a1-d3ee-4f62-b7f2-16f7ac12ef05 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:06.559215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1116/2251] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:17:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 16:17:08.444752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:08.446109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:08.449206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:08.452635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1136/2252] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:17:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:17:08.464704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c244-e950-42ff-9d50-153390d71ea0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:08.465402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c244-e950-42ff-9d50-153390d71ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:08.466019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225c244-e950-42ff-9d50-153390d71ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:08.552231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1225c244-e950-42ff-9d50-153390d71ea0 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:08.562229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1225c244-e950-42ff-9d50-153390d71ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:08.763729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1117/2253] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:17:08.779293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:08.781086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:08.796913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc36f6-284a-4036-9216-77c889b4019a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:08.800842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:08.801461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:08.801759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:08.802034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:08.817936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:08.820112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba627a2-3885-41d1-8ad8-42cfd9d57646 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:08.854986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1137/2254] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:17:08.997725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:08.998320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:08.998942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.001771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1118/2255] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:17:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:17:09.011613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72403-a10d-4e08-b244-df858fbba50f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:09.011900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72403-a10d-4e08-b244-df858fbba50f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:09.012181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72403-a10d-4e08-b244-df858fbba50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.053536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-45c72403-a10d-4e08-b244-df858fbba50f None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:09.055339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-45c72403-a10d-4e08-b244-df858fbba50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:09.175817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1138/2256] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:09.198860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:09.207102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:09.225162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e03c-09c3-44f3-b629-cd9581962cbd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:09.230849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:09.231860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:09.232463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:09.232824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.246823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:09.248543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef77ed-a401-4308-bd6b-72254169681f service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:09.257742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1119/2257] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:17:09.400310 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb7f4-7fbb-4975-96e8-7e5f322f6712 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:09.400714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb7f4-7fbb-4975-96e8-7e5f322f6712 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:09.401138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb7f4-7fbb-4975-96e8-7e5f322f6712 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.403680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1139/2258] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:17:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:17:09.412467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9bcf-927e-4db9-bd85-7c6d1066c46c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:09.412845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9bcf-927e-4db9-bd85-7c6d1066c46c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:09.413185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9bcf-927e-4db9-bd85-7c6d1066c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.466305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a40e9bcf-927e-4db9-bd85-7c6d1066c46c None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:09.467469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a40e9bcf-927e-4db9-bd85-7c6d1066c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:09.482568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1120/2259] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:09.498567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fb7f4-7fbb-4975-96e8-7e5f322f6712 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:09.520224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fb7f4-7fbb-4975-96e8-7e5f322f6712 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:09.527502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:09.528509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:09.528988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:09.529427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:09.547415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:09.548950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:09.561097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1140/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:17:19.459896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=49 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:19.555937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=38 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:24.527529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564289-98ce-4733-8341-5a8006a651df None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:24.528260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564289-98ce-4733-8341-5a8006a651df None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:24.528393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564289-98ce-4733-8341-5a8006a651df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:24.554373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a564289-98ce-4733-8341-5a8006a651df None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:24.554373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a564289-98ce-4733-8341-5a8006a651df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:24.573195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1121/2261] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:17:24.587650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:24.601685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad3582-ac44-4ac3-b016-4ce90a79bf6c service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:24.608678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:24.609286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:24.609640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:24.609825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:24.620829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:24.622435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:24.635949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1141/2262] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:17:26.832035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988efe8-0c4e-435d-95e4-61f0937d858d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:26.834920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988efe8-0c4e-435d-95e4-61f0937d858d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:26.834920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988efe8-0c4e-435d-95e4-61f0937d858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:26.913969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4988efe8-0c4e-435d-95e4-61f0937d858d None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:26.915728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4988efe8-0c4e-435d-95e4-61f0937d858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:26.942750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1122/2263] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:26.951725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:26.982273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6ef1-cafb-4b6b-914c-4419b07cdce7 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:27.003213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:27.009099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:27.009614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:27.010882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:27.027020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:27.032016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:27.048577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1142/2264] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:17:36.889483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:37.041214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=12 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:47.075143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:47.076555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:47.077139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:47.108060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:47.109621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:47.118419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1123/2265] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:47.133170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:47.145531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ba992-3ce7-4928-80ee-dd401c74550d service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:47.151906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:47.152789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:47.153215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:47.153684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:47.168012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:47.171356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:47.183499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1143/2266] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:17:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:17:50.030813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:50.032843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:50.226640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee789ad-e359-4507-a7d4-4470d405a473 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:50.236043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:50.237085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:50.237559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:50.238603 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] PATH_INFO: `/v3/users/988f82551b5e4225bb0b62badda1e4fc` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:50.240068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] RBAC: Authorizing `identity:delete_user(user_id=988f82551b5e4225bb0b62badda1e4fc)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:50.242165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:50.315438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988f82551b5e4225bb0b62badda1e4fc'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.345017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988f82551b5e4225bb0b62badda1e4fc'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.346053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988f82551b5e4225bb0b62badda1e4fc'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.346964 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988f82551b5e4225bb0b62badda1e4fc'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.362226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0fe90c35-463f-4a32-a952-a4bc49d877de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988f82551b5e4225bb0b62badda1e4fc'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.389199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1124/2267] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:17:50 2022] DELETE /identity/v3/users/988f82551b5e4225bb0b62badda1e4fc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:17:50.640700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:50.668488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf643-8f39-43c9-8543-bbae783ab246 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:50.806767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:50.806767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:50.806767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:50.806767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] PATH_INFO: `/v3/projects/77ff27c50d6246d1bda62d1f2977b40d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:50.809432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ff27c50d6246d1bda62d1f2977b40d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:50.813093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:50.926842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ff27c50d6246d1bda62d1f2977b40d', 'request_id': 'req-7da14e61-8858-4a5c-9857-972efb8f5701'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.938791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ff27c50d6246d1bda62d1f2977b40d', 'request_id': 'req-7da14e61-8858-4a5c-9857-972efb8f5701'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:50.957431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ff27c50d6246d1bda62d1f2977b40d', 'request_id': 'req-7da14e61-8858-4a5c-9857-972efb8f5701'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:51.019897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] The token cache is being invalidate because project 77ff27c50d6246d1bda62d1f2977b40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:17:51.020411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:51.021626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7da14e61-8858-4a5c-9857-972efb8f5701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:17:51.024883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1144/2268] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:17:50 2022] DELETE /identity/v3/projects/77ff27c50d6246d1bda62d1f2977b40d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:17:51.029290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.029872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.030393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.063486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:51.065775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:51.259707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1125/2269] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:51.271336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.271616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.271889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.354105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:51.357503 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:51.379280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1145/2270] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:51.383246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.404328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45980f-1d8d-43bb-9147-eff47c926258 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.420428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.421444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.421898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.422307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.423166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:17:51.423639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.425477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.444847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:51.454101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1126/2271] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:17:51.456009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.478550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82f0aa-51c2-4f77-b218-42f8619c849f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.482902 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.483535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.483818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.484089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.484728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.486942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.532701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1146/2272] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:17:51.537237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.548263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5bb77-a5ed-4d97-8ac8-7ccfef1e8347 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.632076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.632688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.632966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.633235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.633874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.635850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.663286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1127/2273] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:17:51.669981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.682698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762c335-5062-4d0e-8dd9-2f97d31bd5af admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.687755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.688564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.689231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.690347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.691782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.693612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.711384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1147/2274] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:17:51.713331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.732342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5bf4e-da02-426b-8034-e334aa743057 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.744912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.746298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.746808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.747562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.748683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.751340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c30199-c165-469e-9aaa-d076df8d7aea admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.778575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1128/2275] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:17:51.780552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.808408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792294f-b564-4474-8aa8-7f5a0011f440 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:51.811129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.811358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.811635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.818146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:51.819497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.820123 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.820643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] PATH_INFO: `/v3/projects/35aa6786153b43998f6fbb60d1671ac0/users/edc80797e4d34c18b4fc15813881b61e/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.840851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:51.842070 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:51.844549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aa6786153b43998f6fbb60d1671ac0, user_id=edc80797e4d34c18b4fc15813881b61e, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:51.847381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a549e-08d5-4f90-907c-51cc00145507 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:51.866691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1148/2276] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:17:51 2022] PUT /identity/v3/projects/35aa6786153b43998f6fbb60d1671ac0/users/edc80797e4d34c18b4fc15813881b61e/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:17:51.884212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:51.884619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:51.885050 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:51.927499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:51.933798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] MFA Rules not processed for user `edc80797e4d34c18b4fc15813881b61e`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:17:51.937802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:51.961464 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1129/2277] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:17:51.983885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:51.986683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:52.086619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1149/2278] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:17:52.102058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:52.104702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:52.119118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36536e6a-344a-4826-add8-4b0baf85255f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:52.157727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:52.214716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340c11d-e660-4a1a-a32f-f52fbaca1400 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:52.216598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:52.217887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:52.218165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:52.218566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:52.219172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:52.219481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:52.219938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:52.220390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:52.238968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:52.241833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:52.261847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1150/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:17:52.360180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:52.363020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309ed1-b392-4229-b124-599140cced90 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:52.380556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1130/2280] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:17:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 16:17:55.907719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:17:55.910204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:55.995685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a62e46-5c76-480d-8331-6afa3fdda165 service glance] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:17:56.002014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:17:56.003041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:17:56.003511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:17:56.003991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:17:56.006062 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:17:56.104119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:17:56.108747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:17:56.111403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:17:56.125976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1151/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:18:02.372825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=42 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:06.122659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:07.251716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e56c-e628-49ec-9675-37089e6fadf3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:07.252338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e56c-e628-49ec-9675-37089e6fadf3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:07.252338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e56c-e628-49ec-9675-37089e6fadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:07.283151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4118e56c-e628-49ec-9675-37089e6fadf3 None None] MFA Rules not processed for user `a11490d644a6482689eb26dd6fe965dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:07.285344 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4118e56c-e628-49ec-9675-37089e6fadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:07.396331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1131/2282] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:17.384519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=25 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:21.029386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:21.133984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57630c-de8b-4600-83ee-28505e8d1d02 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:21.144453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:21.145453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:21.145890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:21.146362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] PATH_INFO: `/v3/users/edc80797e4d34c18b4fc15813881b61e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:21.148137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc80797e4d34c18b4fc15813881b61e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:21.150104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:21.245245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc80797e4d34c18b4fc15813881b61e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:21.258013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc80797e4d34c18b4fc15813881b61e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:21.259093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc80797e4d34c18b4fc15813881b61e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:21.260044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc80797e4d34c18b4fc15813881b61e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:21.271425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc80797e4d34c18b4fc15813881b61e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:21.306578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1152/2283] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:18:21 2022] DELETE /identity/v3/users/edc80797e4d34c18b4fc15813881b61e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:18:21.312176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:21.313066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:21.313066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:21.337236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:21.339031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:21.428931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1132/2284] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:21.446665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:21.448994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:21.539626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a36240-38dd-4711-8777-0420866b82b4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:21.545222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:21.545974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:21.546353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:21.546900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:21.568212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:21.569960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c12e24-b6fe-4da8-81d4-a5398eb92090 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:21.582615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1153/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:18:22.053444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.054976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:22.090657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fa64-d694-416a-99d4-ec2374b1b509 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.098897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.100116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.100609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.101197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] PATH_INFO: `/v3/projects/35aa6786153b43998f6fbb60d1671ac0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.103326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35aa6786153b43998f6fbb60d1671ac0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.107366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.180783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35aa6786153b43998f6fbb60d1671ac0', 'request_id': 'req-90486c92-7ccf-4bff-8ac3-a43317e34387'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:22.193248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35aa6786153b43998f6fbb60d1671ac0', 'request_id': 'req-90486c92-7ccf-4bff-8ac3-a43317e34387'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:22.204707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35aa6786153b43998f6fbb60d1671ac0', 'request_id': 'req-90486c92-7ccf-4bff-8ac3-a43317e34387'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:22.227867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] The token cache is being invalidate because project 35aa6786153b43998f6fbb60d1671ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:18:22.228244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:22.229067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-90486c92-7ccf-4bff-8ac3-a43317e34387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:22.234880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1133/2286] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:18:22 2022] DELETE /identity/v3/projects/35aa6786153b43998f6fbb60d1671ac0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:18:22.238400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.239376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.239854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.269294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:22.270566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:22.299359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:22.361124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1154/2287] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:22.370654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.371306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.371593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.404367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:22.407046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:22.417240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1134/2288] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:22.422243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.433592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa9a9-40e2-4a09-b54e-7d35b00d5bbf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.443582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.444447 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.444812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.445215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.446061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:18:22.446510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.448242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.462313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1155/2289] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:18:22.466734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.476255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f1c99-0d75-4446-9c9a-298f433adcf2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.485193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.486240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.486764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.487251 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.488429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.492139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.532335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1135/2290] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:18:22.537130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.548558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90b21-f086-462b-abd3-525701f95cf6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.607022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.607621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.608201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.608472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.609090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.611049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.644981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1156/2291] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:18:22 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:18:22.646224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.657501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e1a5-1c33-4768-bfd9-7e4843f0a01f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.662572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.663519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.663975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.664537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.665424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.667313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.678409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1136/2292] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:18:22.683645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.695314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249228-f98c-48eb-8931-0bc50ee6d62c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.700365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.701161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.701651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.701933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.702852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.707608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf446a-e912-46f1-870b-af2d54498119 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.719018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1157/2293] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:18:22.723369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.736846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495c17-0353-4103-8266-248e0c357842 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:22.744763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:22.745828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.746325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.747039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] PATH_INFO: `/v3/projects/fc39d8b779c14dd1b3cd8005d4101d4d/users/7aecf49326ba485183eae2c46803f8c6/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.772087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc39d8b779c14dd1b3cd8005d4101d4d, user_id=7aecf49326ba485183eae2c46803f8c6, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:22.776226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:22.797293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1137/2294] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:18:22 2022] PUT /identity/v3/projects/fc39d8b779c14dd1b3cd8005d4101d4d/users/7aecf49326ba485183eae2c46803f8c6/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:18:22.811199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:22.811623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:22.811970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:22.853048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] MFA Rules not processed for user `7aecf49326ba485183eae2c46803f8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:22.855225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:22.937953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1158/2295] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:18:22.953748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:22.955591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:22.986976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:23.036235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ca04e-a7f9-4903-b8d4-a1da8295d238 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:23.040386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:23.040991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:23.041265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:23.041537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:23.051926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:23.053393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ad516-b4df-4dc4-adcd-c122bac0ea63 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:23.062899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1138/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:18:23.095274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:23.119822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:23.180072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cb1a9-c94a-479b-988d-775ddff74d05 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:23.184874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:23.185512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:23.185784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:23.186054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] PATH_INFO: `/v3/users/7aecf49326ba485183eae2c46803f8c6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:23.187279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aecf49326ba485183eae2c46803f8c6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:23.189266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:23.253793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aecf49326ba485183eae2c46803f8c6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.262231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aecf49326ba485183eae2c46803f8c6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.263157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aecf49326ba485183eae2c46803f8c6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.263811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aecf49326ba485183eae2c46803f8c6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.272175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aecf49326ba485183eae2c46803f8c6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.297908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1159/2297] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:18:23 2022] DELETE /identity/v3/users/7aecf49326ba485183eae2c46803f8c6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:18:23.302633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:23.303080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:23.303476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:23.325388 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:23.327364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:23.404102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1139/2298] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:18:23.414827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:23.416445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:23.493736 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5793-1d52-4f31-993b-25f6ace48289 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:23.497866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:23.498471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:23.498776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:23.499044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:23.509671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:23.511150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c035-fad0-4896-9698-a0bbd3c03c76 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:23.520885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1160/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:18:23.842014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:23.843744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:23.857987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7c905-fcc5-48da-b129-660938389956 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:23.863730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:23.864385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:23.864652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:23.864956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] PATH_INFO: `/v3/projects/fc39d8b779c14dd1b3cd8005d4101d4d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:23.866139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc39d8b779c14dd1b3cd8005d4101d4d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:23.868196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:23.936908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc39d8b779c14dd1b3cd8005d4101d4d', 'request_id': 'req-4b878644-0b9f-4412-ae8a-ea321212d299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.951575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc39d8b779c14dd1b3cd8005d4101d4d', 'request_id': 'req-4b878644-0b9f-4412-ae8a-ea321212d299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.959026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc39d8b779c14dd1b3cd8005d4101d4d', 'request_id': 'req-4b878644-0b9f-4412-ae8a-ea321212d299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.977383 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] The token cache is being invalidate because project fc39d8b779c14dd1b3cd8005d4101d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:18:23.977652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.978338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:18:23.979930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1140/2300] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:18:23 2022] DELETE /identity/v3/projects/fc39d8b779c14dd1b3cd8005d4101d4d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:18:29.027616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:29.028206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:29.028206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:29.049477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] MFA Rules not processed for user `dd8269c9310d457ab007d0beec62f1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:29.050734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:29.090477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:29.124216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1161/2301] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:33.973352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:39.112470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:45.519572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:45.522210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:45.611312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878644-0b9f-4412-ae8a-ea321212d299 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:45.617426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:45.618432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:45.618955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:45.618955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:45.621979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:45.772298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:45.775121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb00e3-c179-4d35-9f8f-13f688aec4c1 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:45.802625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1141/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:18:47.927445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:47.946764 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcfaa6-2594-44ce-abb6-38d952d381f7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:47.953107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:47.954125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:47.954622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:47.955094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:47.958065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:47.976861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:47.978684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:47.999321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1162/2303] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:18:55.163500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:55.164503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:55.164503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:55.192888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] MFA Rules not processed for user `6c49fa2c8e9347478e7e434efd0fb80f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:18:55.194703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:55.261389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1142/2304] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:18:57.991170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:18:58.628693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:18:58.631466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:58.748273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57801-f184-43f2-923d-e5b8688c34eb service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:18:58.752667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:18:58.753572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:18:58.754011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:18:58.754471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:18:58.756523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:18:58.847633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:18:58.855497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e6e1-bf46-4d3f-bf4a-4319fcc6d0e9 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:18:58.870793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1163/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:02.433662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:02.436183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:02.459785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8795f4-8f00-4335-9dc2-d0355595cc8b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:02.468087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:02.468755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:02.470194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:02.470194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:02.472419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:02.484868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:02.487337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:02.501697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1143/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:07.810985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:07.811707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:07.811986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:07.844027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] MFA Rules not processed for user `aa7006ee52de44598022d4326747b427`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:19:07.846124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:07.857864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1164/2307] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:19:08.272550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:08.292850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77edca-99eb-4e2f-b112-9d228f165eb0 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:08.301256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:08.302143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:08.302549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:08.302922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:08.304939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:08.329717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:08.339995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6f18f-654e-4d6c-959b-8bcf6d5bab67 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:08.344365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:08.344990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:08.345262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:08.345528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:08.347336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:08.347898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:08.362925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:08.365431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:08.377717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1165/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:19:08.387050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:08.388606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:08.400289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1144/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:08.789299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:08.792074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:08.884291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb8dd-fc3d-4484-91f8-c4e85ca2bcd9 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:08.889585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:08.890200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:08.891080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:08.891356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:08.893127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:08.905596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:08.907408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:08.920967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1166/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:17.478361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:17.491665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c752d-7d4a-4cae-94de-5b433147b4de service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:17.496060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:17.496778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:17.497315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:17.497514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:17.499619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:17.512207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:17.513830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5aed9-1e69-4ead-bfed-7668ebcdf88e service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:17.524650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1145/2311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:18.913707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:22.371087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:22.385372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d2b5-01c7-4b23-9524-4a0a118791d0 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:22.390856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:22.391351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:22.391813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:22.392330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:22.395498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:22.416097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:22.418728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:22.432810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1167/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:24.187823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:24.188662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:24.188662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:24.212392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] MFA Rules not processed for user `a11490d644a6482689eb26dd6fe965dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:19:24.214171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:24.223540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1146/2313] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:19:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:19:30.606125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:30.640483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87e30-da32-4d57-9859-d234618f96b1 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:30.663335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:30.663993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:30.667203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:30.668100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:30.673537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:30.707712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:30.711577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:30.731721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1168/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:30.904266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:30.949209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0f16a-e4a9-4105-82da-bb16812ef8cf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:30.965441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:30.966843 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:30.968084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:30.968621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:30.971338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:31.012414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:31.019249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:31.059040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1147/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:19:39.427180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:39.432615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:39.454391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271bf6-56f2-4684-94e5-8c2099d9e587 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:39.462075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:39.464444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:39.466371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:39.467022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:39.470782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:39.499530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:39.501214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:39.517598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1169/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:41.034749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=28 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:46.531780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:46.549783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7138-7d80-4991-8a15-64621e970a0c service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:46.556520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:46.557570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:46.558056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:46.558585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:46.562192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:46.655655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:46.658188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:46.671494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1148/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:19:49.509170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=18 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:51.017512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.019022 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:51.040243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4572ca-79fd-40c7-99e5-04700e839102 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.045638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.046298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.047007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.047007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] PATH_INFO: `/v3/users/dd8269c9310d457ab007d0beec62f1b8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.048156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8269c9310d457ab007d0beec62f1b8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.050286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.111611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8269c9310d457ab007d0beec62f1b8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.119848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8269c9310d457ab007d0beec62f1b8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.120646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8269c9310d457ab007d0beec62f1b8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.121307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8269c9310d457ab007d0beec62f1b8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.131445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4a01de3-010c-4c53-871f-e7553dd58317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8269c9310d457ab007d0beec62f1b8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.159482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1170/2318] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:19:51 2022] DELETE /identity/v3/users/dd8269c9310d457ab007d0beec62f1b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:19:51.366109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.379925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4d97-30ad-4c93-b26b-dd509b74367b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.457181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.457851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.458131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.458403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] PATH_INFO: `/v3/projects/59235a45c11b404184d25c6bdc2add41` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.459570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59235a45c11b404184d25c6bdc2add41)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.461518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.513544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59235a45c11b404184d25c6bdc2add41', 'request_id': 'req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.521848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59235a45c11b404184d25c6bdc2add41', 'request_id': 'req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.528178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59235a45c11b404184d25c6bdc2add41', 'request_id': 'req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.540470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] The token cache is being invalidate because project 59235a45c11b404184d25c6bdc2add41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:19:51.540756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.541423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ac0d70cd-eeb0-4370-8a6d-ba8c6b48f3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:19:51.542961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1149/2319] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:19:51 2022] DELETE /identity/v3/projects/59235a45c11b404184d25c6bdc2add41 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:19:51.550364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda23e-6195-4840-9c07-8593163de520 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.550724 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda23e-6195-4840-9c07-8593163de520 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.551069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feda23e-6195-4840-9c07-8593163de520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.576458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2feda23e-6195-4840-9c07-8593163de520 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:19:51.577665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2feda23e-6195-4840-9c07-8593163de520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:51.637540 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1171/2320] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:19:51.645266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.645541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.645807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.666731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:19:51.667952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:51.676367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1150/2321] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:19:51.680604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feda23e-6195-4840-9c07-8593163de520 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.691063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feda23e-6195-4840-9c07-8593163de520 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.695877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.696474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.696748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.697018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.697843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:19:51.698162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.699855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.713094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1172/2322] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:19:51.718413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.728492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c371f4-99a8-4e71-bbfd-d3564859748f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.734226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.734874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.735145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.735413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.736071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.737953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.755103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:51.771763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1151/2323] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:19:51 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:19:51.776055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.791478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ba9c0-e4ab-4951-b1ee-86bed819588f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.854107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.855044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.855326 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.855598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.856231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.858817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.867288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:19:51.884960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1173/2324] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:19:51 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:19:51.889387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.900936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee050-9a27-49f6-9525-1466c1cbeedc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.906315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.906991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.907271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.907551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.908182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.909848 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.921971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1152/2325] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:19:51.926993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.938423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d3dfc-f625-4967-a8dc-863a40ee1a6e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.943216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.943811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.944087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.944357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.944999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:51.946651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ce30b-e218-499f-a190-acef3fe52f7f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:51.959149 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1174/2326] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:19:51.963638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:51.974891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883c79-0f31-4c2e-aac0-dce9213c97e8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:51.980463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:51.981144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:51.981467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:51.981769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] PATH_INFO: `/v3/projects/877b623c6b304bb39088e1d8cf9370c4/users/9d45dc0d73fd428faa48fde1e12c8ad2/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:51.999986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877b623c6b304bb39088e1d8cf9370c4, user_id=9d45dc0d73fd428faa48fde1e12c8ad2, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:52.003170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:52.018894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1153/2327] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:19:51 2022] PUT /identity/v3/projects/877b623c6b304bb39088e1d8cf9370c4/users/9d45dc0d73fd428faa48fde1e12c8ad2/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:19:52.030955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:52.031628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:52.031628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:52.060743 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] MFA Rules not processed for user `9d45dc0d73fd428faa48fde1e12c8ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:19:52.061958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:52.142823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1175/2328] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:19:52.156773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:19:52.159181 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:19:52.235003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a517-98ec-4dd4-84c7-5d59a7a63741 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:19:52.238804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:19:52.239413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:19:52.239688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:19:52.239957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:19:52.248645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:19:52.250068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9caad-a9ad-4fc6-ac3d-d821536c83c9 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:19:52.259595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1154/2329] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:19:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:00.925444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:01.002802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944b8c-45ce-40c1-a65f-82fabc319384 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:01.007832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:01.008478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.008939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.009239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] PATH_INFO: `/v3/users/9d45dc0d73fd428faa48fde1e12c8ad2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:01.010370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d45dc0d73fd428faa48fde1e12c8ad2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:01.012342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:01.080918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d45dc0d73fd428faa48fde1e12c8ad2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.090712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d45dc0d73fd428faa48fde1e12c8ad2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.091723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d45dc0d73fd428faa48fde1e12c8ad2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.092649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d45dc0d73fd428faa48fde1e12c8ad2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.105194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d45dc0d73fd428faa48fde1e12c8ad2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.113403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:01.130717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1176/2330] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:00 2022] DELETE /identity/v3/users/9d45dc0d73fd428faa48fde1e12c8ad2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:01.135840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.136337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.136436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:01.156196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:01.157408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:01.238268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1155/2331] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:01.249411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:01.250845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:01.327627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b3eb-0f15-4544-9106-c853936ca5aa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:01.333153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:01.333947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.334300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.334691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:01.350237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:01.353845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b23a54-c4b8-4c02-bce0-4e02c40cb350 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:01.378617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1177/2332] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:01.725629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:01.728109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:01.743061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588bad-6a76-44ea-b47e-53830caba5fc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:01.750297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:01.750864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.751258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.751661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] PATH_INFO: `/v3/projects/877b623c6b304bb39088e1d8cf9370c4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:01.753830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] RBAC: Authorizing `identity:delete_project(project_id=877b623c6b304bb39088e1d8cf9370c4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:01.756797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:01.824961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877b623c6b304bb39088e1d8cf9370c4', 'request_id': 'req-06c76f28-8c73-4d73-8276-26b20618664c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.834162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877b623c6b304bb39088e1d8cf9370c4', 'request_id': 'req-06c76f28-8c73-4d73-8276-26b20618664c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.836868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:01.842381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877b623c6b304bb39088e1d8cf9370c4', 'request_id': 'req-06c76f28-8c73-4d73-8276-26b20618664c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.856192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] The token cache is being invalidate because project 877b623c6b304bb39088e1d8cf9370c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:01.856508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.857169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-06c76f28-8c73-4d73-8276-26b20618664c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:01.858698 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1156/2333] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:01 2022] DELETE /identity/v3/projects/877b623c6b304bb39088e1d8cf9370c4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:01.865792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.866242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.866719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:01.888255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:01.889729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:01.965453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1178/2334] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:01.974093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:01.974373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:01.974681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.004726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:02.006236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:02.017317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1157/2335] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:02.022759 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.038714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbfa22-e9ff-48ac-b148-b7eb6c783ad7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.043778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.044405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.044703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.045004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.045670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:02.045914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.047545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.060462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1179/2336] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:02.065066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.074644 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d60c2-9575-4b7f-8640-fff043ac61b6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.080570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.081305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.081706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.082086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.083081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.085302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.121449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1158/2337] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:02 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:02.126654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.137481 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2487-3c1c-42d6-a56e-34b5a350ce58 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.212102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.212706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.212978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.213250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.213870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.216451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.241333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1180/2338] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:02 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:02.246627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.265550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f633ab-83d5-43b8-9bea-ea8ee82686da admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.270918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.271533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.271937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.271937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.272737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.274290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.286628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1159/2339] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:02.291604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.302726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f5c0-34c9-4072-a221-d63a353097a2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.307686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.308286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.308564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.308835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.310008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.311665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af894-0038-4ecd-83b8-9e56b5ab2ec4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.313223 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:02.331628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1181/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:02.333154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.346590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629bd2-6fa3-4593-8c69-26fad48225f1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.352609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.353331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.353609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.353930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] PATH_INFO: `/v3/projects/1b7dab9ae1c94b8c87ac4905f22441ee/users/bb43a9a52641455ab6eeae5d2d5f9124/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.371333 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7dab9ae1c94b8c87ac4905f22441ee, user_id=bb43a9a52641455ab6eeae5d2d5f9124, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.374527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.391837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1160/2341] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:02 2022] PUT /identity/v3/projects/1b7dab9ae1c94b8c87ac4905f22441ee/users/bb43a9a52641455ab6eeae5d2d5f9124/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:02.403652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.404101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.404555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.444492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] MFA Rules not processed for user `bb43a9a52641455ab6eeae5d2d5f9124`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:02.445729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:02.530631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1182/2342] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:02.540659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.620091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ff5a-06d9-469f-ad9c-6e94d76433be admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.625548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.626182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.626462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.626767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.627400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.629297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.664534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1161/2343] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:02 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:02.670051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.685155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66167e-0761-4b97-92f7-eb1dbdb2512f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.765116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.765956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.766408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.767208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.768536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.772226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.798288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1183/2344] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:02 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:02.804206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.821809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37866c8f-6238-4737-b4b3-380960cf3e20 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.827649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.828253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.828634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.828909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.829551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.831230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.843337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1162/2345] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:02.849287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.860921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b267c3-c98c-4067-8a7c-6688e4d76e42 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.865930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.866640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.866974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.867523 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] PATH_INFO: `/v3/projects/41310eab8472492786ca9707020dd692/users/ec63a3797485421aa127004c2debcd35/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.886094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41310eab8472492786ca9707020dd692, user_id=ec63a3797485421aa127004c2debcd35, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.889283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:02.908695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1184/2346] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:02 2022] PUT /identity/v3/projects/41310eab8472492786ca9707020dd692/users/ec63a3797485421aa127004c2debcd35/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:02.914899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:02.926819 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf16cbb-b1af-444d-9997-195106dd7954 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:02.983073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:02.994661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:02.995428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:02.995712 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:02.995991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:02.996633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:02.998727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639ffb-e5c9-4c2e-813f-c09c4eed1f50 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:03.011265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1163/2347] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:03.016813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:03.030655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82352808-096a-45ed-b91a-710fc5b4d043 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:03.036431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:03.037281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:03.037809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:03.038085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] PATH_INFO: `/v3/projects/41310eab8472492786ca9707020dd692/users/ec63a3797485421aa127004c2debcd35/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:03.040146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41310eab8472492786ca9707020dd692, user_id=ec63a3797485421aa127004c2debcd35, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:03.043790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:03.056096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1185/2348] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:03 2022] PUT /identity/v3/projects/41310eab8472492786ca9707020dd692/users/ec63a3797485421aa127004c2debcd35/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:03.068653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:03.068937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:03.069219 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:03.099104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] MFA Rules not processed for user `ec63a3797485421aa127004c2debcd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:03.100356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:03.172012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1164/2349] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:03.184345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:03.186053 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:03.229700 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:03.246931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ca6a3-6011-4118-bfe0-610fb68de7e9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:03.250643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:03.251256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:03.251532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:03.252456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:03.267533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:03.269074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:03.280420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1186/2350] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:03.361159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:03.374701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a6c0-ee3f-4083-a611-3db32dbe6ed6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:03.379020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:03.379659 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:03.379935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:03.380205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:03.451839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:03.454371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbf36a-57d0-47e8-95ce-ee2108cf2ed9 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:03.463484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1165/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:06.379549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:06.455494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81bb60-f728-440f-9599-5be1b9e548f6 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:06.459996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:06.460615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:06.460903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:06.461161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] PATH_INFO: `/v3/users/bb43a9a52641455ab6eeae5d2d5f9124` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:06.462291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb43a9a52641455ab6eeae5d2d5f9124)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:06.464249 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:06.511333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb43a9a52641455ab6eeae5d2d5f9124'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:06.519420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb43a9a52641455ab6eeae5d2d5f9124'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:06.520140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb43a9a52641455ab6eeae5d2d5f9124'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:06.520863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb43a9a52641455ab6eeae5d2d5f9124'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:06.530417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb43a9a52641455ab6eeae5d2d5f9124'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:06.549424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1187/2352] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:06 2022] DELETE /identity/v3/users/bb43a9a52641455ab6eeae5d2d5f9124 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:06.554005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:06.554514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:06.554637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:06.574099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:06.576000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:06.652307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1166/2353] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:06.663354 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:06.665228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:06.735845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1b8c-59bb-4d26-8035-dc7d49554a8d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:06.739885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:06.740493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:06.740770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:06.741039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:06.751311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:06.752755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:06.769041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1188/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:07.097244 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:07.099258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:07.112696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb3410-252e-4d8b-9731-ba19a67ad241 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:07.119085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:07.119885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:07.120055 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:07.120402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] PATH_INFO: `/v3/projects/1b7dab9ae1c94b8c87ac4905f22441ee` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:07.127212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7dab9ae1c94b8c87ac4905f22441ee)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:07.129152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:07.155176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:07.198958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7dab9ae1c94b8c87ac4905f22441ee', 'request_id': 'req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.207880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7dab9ae1c94b8c87ac4905f22441ee', 'request_id': 'req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.213744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7dab9ae1c94b8c87ac4905f22441ee', 'request_id': 'req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.225970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] The token cache is being invalidate because project 1b7dab9ae1c94b8c87ac4905f22441ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:07.226372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.227407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.228972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1167/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:07 2022] DELETE /identity/v3/projects/1b7dab9ae1c94b8c87ac4905f22441ee => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:07.233181 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:07.238066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:07.249564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce06-8931-44a6-a98a-95cf833c5491 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:07.335387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:07.336209 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:07.336491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:07.336827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] PATH_INFO: `/v3/users/ec63a3797485421aa127004c2debcd35` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:07.338055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec63a3797485421aa127004c2debcd35)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:07.340046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:07.416807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec63a3797485421aa127004c2debcd35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.432184 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec63a3797485421aa127004c2debcd35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.433381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec63a3797485421aa127004c2debcd35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.435113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec63a3797485421aa127004c2debcd35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.449124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e0361a23-4c55-4384-90f1-0352c189827b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec63a3797485421aa127004c2debcd35'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.471402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1189/2356] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:07 2022] DELETE /identity/v3/users/ec63a3797485421aa127004c2debcd35 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:07.793958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:07.795473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:07.809335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5401-5f53-4cf7-bb7a-5115f81d6fff admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:07.872364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:07.872887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:07.873194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:07.873756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] PATH_INFO: `/v3/projects/41310eab8472492786ca9707020dd692` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:07.874785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41310eab8472492786ca9707020dd692)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:07.876731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:07.949374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41310eab8472492786ca9707020dd692', 'request_id': 'req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.958404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41310eab8472492786ca9707020dd692', 'request_id': 'req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.967566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41310eab8472492786ca9707020dd692', 'request_id': 'req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.982808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] The token cache is being invalidate because project 41310eab8472492786ca9707020dd692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:07.983127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.983759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83fcd875-8af8-4bb3-9fe3-9e481d706ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:07.985261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1168/2357] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:07 2022] DELETE /identity/v3/projects/41310eab8472492786ca9707020dd692 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:07.990348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:07.990682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:07.990958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.010665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:08.011869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:08.084843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1190/2358] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:08.093048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.093660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.094061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.116144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:08.117673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:08.127506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1169/2359] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:08.132104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.142822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031bfc1-f8ca-4f8f-9cb7-d001e38fde05 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.149548 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.150430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.150855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.151290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.152043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:08.152411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.154006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.167941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1191/2360] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:08.172580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.183297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365673be-4b3b-44f8-8669-b2dcf22d60b7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.188736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.189341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.189619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.189890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.190561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.192491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.223728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1170/2361] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:08.228026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.239031 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5d9a-2840-4ac1-ae7a-c11f06e211f4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.245748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:08.310857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.311471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.311745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.312014 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.312654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.314600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.339744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1192/2362] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:08.343821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.349350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:08.363979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca121e-1382-4cdf-8bb2-35a5943af2f0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.372268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.373120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.373425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.373731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.374674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.376566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.389458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1171/2363] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:08.394187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.404783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8c61d-4fb8-4919-9e44-0b8be9450629 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.410675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.411290 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.411561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.411829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.412733 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.416966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970cbdc-9dad-462e-b00d-c6dac73ae701 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.427108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1193/2364] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:08.431218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.443458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eb9fa-116f-4418-9053-a1a9bce4c52c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.455469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.457665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.457945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.458227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] PATH_INFO: `/v3/projects/d7c64080aa4c4c80b81cb8293bf7ffce/users/4fddb79a0bf04acea25baab5cf051450/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.475293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c64080aa4c4c80b81cb8293bf7ffce, user_id=4fddb79a0bf04acea25baab5cf051450, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.478089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.493604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1172/2365] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:08 2022] PUT /identity/v3/projects/d7c64080aa4c4c80b81cb8293bf7ffce/users/4fddb79a0bf04acea25baab5cf051450/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:08.504488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.504876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.505185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.535129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] MFA Rules not processed for user `4fddb79a0bf04acea25baab5cf051450`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:08.536807 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:08.657241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1194/2366] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:08.658165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.798811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1290b-6a8a-4d0d-9bd2-557927b65f88 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.817933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.819217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.819574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.819987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.820713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.823618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:08.862363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1173/2367] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/projects => generated 369 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:08.868683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:08.889047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa00304-4ffb-412a-9ac5-9bb0c2bbb6b6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:08.991452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:08.992786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:08.993283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:08.993777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:08.995090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:08.999478 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.045081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1195/2368] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:08 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:09.049724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.064256 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e083c5b-1202-4a7b-bd6b-990df70085ad admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.070537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.071185 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.071468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.071743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.072407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.074527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.095786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1174/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:09.100269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.114334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b2ec-af95-4bcb-89db-e1212629e9b9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.119936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.120631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.120909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.121180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] PATH_INFO: `/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7/users/9f5143cb36094ddcaf62cd7eca2d4cf0/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.124040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:09.151250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a10486e58449c9b81b8a4d7d6350f7, user_id=9f5143cb36094ddcaf62cd7eca2d4cf0, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.155732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.177569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1196/2370] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:09 2022] PUT /identity/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7/users/9f5143cb36094ddcaf62cd7eca2d4cf0/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:09.185618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.204351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca47e-786c-45cb-914a-a465a7218e64 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.285616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.286255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.286567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.286846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.287764 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.289451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ceaa8a-0e2b-4626-b097-750725024a9c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.304180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1175/2371] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:09.309304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.321488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8f508-aed2-43aa-96d3-61b3d6828f20 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.331591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.334007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.334650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.335614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] PATH_INFO: `/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7/users/9f5143cb36094ddcaf62cd7eca2d4cf0/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.338504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a10486e58449c9b81b8a4d7d6350f7, user_id=9f5143cb36094ddcaf62cd7eca2d4cf0, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.343392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.359729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1197/2372] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:09 2022] PUT /identity/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7/users/9f5143cb36094ddcaf62cd7eca2d4cf0/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:09.373359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.373622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.373900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.408183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] MFA Rules not processed for user `9f5143cb36094ddcaf62cd7eca2d4cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:09.409356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:09.441655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:09.500771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1176/2373] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:09.512979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.514906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:09.611667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ade9b-51ed-4b4d-b402-92a3f1828326 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.618696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.619668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.620097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.620509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.635436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.637263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.655543 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1198/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:09.706309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:09.712593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:09.722135 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba9675-c258-4755-a00f-67e98c6541d5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:09.728785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:09.729834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:09.730220 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:09.730665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:09.821086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:09.823898 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe89958-edf9-4940-8cfb-4b2a891bf04e service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:09.839252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1177/2375] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:13.798036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:13.886697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922e43a-8c47-43df-b206-cb2678198cfa service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:13.892224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:13.892872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:13.893148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:13.893524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] PATH_INFO: `/v3/users/4fddb79a0bf04acea25baab5cf051450` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:13.894740 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fddb79a0bf04acea25baab5cf051450)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:13.896784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:13.961574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fddb79a0bf04acea25baab5cf051450'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:13.972683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fddb79a0bf04acea25baab5cf051450'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:13.973591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fddb79a0bf04acea25baab5cf051450'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:13.974387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fddb79a0bf04acea25baab5cf051450'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:13.982890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fddb79a0bf04acea25baab5cf051450'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:13.994116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:14.007335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1199/2376] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:13 2022] DELETE /identity/v3/users/4fddb79a0bf04acea25baab5cf051450 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:14.014454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:14.015235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:14.015490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:14.039833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:14.041123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:14.125390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1178/2377] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:14.135742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:14.137678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:14.221185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cf31-1f26-43e3-858c-bd1d9b56f0aa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:14.226407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:14.227239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:14.227625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:14.227928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:14.240069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:14.241515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:14.251940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1200/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:14.605781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:14.607482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:14.623895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa23e-245d-481c-8ab0-8076c25fa08a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:14.629053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:14.629702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:14.629981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:14.630257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] PATH_INFO: `/v3/projects/d7c64080aa4c4c80b81cb8293bf7ffce` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:14.632374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c64080aa4c4c80b81cb8293bf7ffce)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:14.634422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:14.712677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c64080aa4c4c80b81cb8293bf7ffce', 'request_id': 'req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.724000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c64080aa4c4c80b81cb8293bf7ffce', 'request_id': 'req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.726578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:14.736192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c64080aa4c4c80b81cb8293bf7ffce', 'request_id': 'req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.756693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] The token cache is being invalidate because project d7c64080aa4c4c80b81cb8293bf7ffce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:14.757088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.758116 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.760939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1179/2379] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:14 2022] DELETE /identity/v3/projects/d7c64080aa4c4c80b81cb8293bf7ffce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:14.768131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:14.783596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb7eb2-95f0-4436-b8a3-4824f90b2f4f service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:14.870833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:14.872210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:14.872800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:14.873157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] PATH_INFO: `/v3/users/9f5143cb36094ddcaf62cd7eca2d4cf0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:14.874398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5143cb36094ddcaf62cd7eca2d4cf0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:14.876655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:14.943452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5143cb36094ddcaf62cd7eca2d4cf0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.952483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5143cb36094ddcaf62cd7eca2d4cf0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.953391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5143cb36094ddcaf62cd7eca2d4cf0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.954324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5143cb36094ddcaf62cd7eca2d4cf0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.966432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1a733811-037e-47f6-b61f-64e302ceb8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5143cb36094ddcaf62cd7eca2d4cf0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:14.992914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1201/2380] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:14 2022] DELETE /identity/v3/users/9f5143cb36094ddcaf62cd7eca2d4cf0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:15.360454 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:15.362075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:15.394283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5b6b-f7a3-49b0-88cd-fcad82a3c8d0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:15.483459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:15.484121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:15.484397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:15.484667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] PATH_INFO: `/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:15.485857 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a10486e58449c9b81b8a4d7d6350f7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:15.487854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:15.556987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a10486e58449c9b81b8a4d7d6350f7', 'request_id': 'req-f1085495-dadf-4306-8308-d4c50f9302b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:15.565795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a10486e58449c9b81b8a4d7d6350f7', 'request_id': 'req-f1085495-dadf-4306-8308-d4c50f9302b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:15.572670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a10486e58449c9b81b8a4d7d6350f7', 'request_id': 'req-f1085495-dadf-4306-8308-d4c50f9302b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:15.587284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] The token cache is being invalidate because project c6a10486e58449c9b81b8a4d7d6350f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:15.587789 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:15.588899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f1085495-dadf-4306-8308-d4c50f9302b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:15.591649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1180/2381] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:15 2022] DELETE /identity/v3/projects/c6a10486e58449c9b81b8a4d7d6350f7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:15.597199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:15.597574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:15.597920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:15.622962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:15.625006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:15.641900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:15.738585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1202/2382] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:15.749826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:15.750222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:15.750727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:15.783196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:15.785315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:15.799974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1181/2383] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:15.806466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:15.823165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cb109-b1da-4292-879e-1e736b6a8e90 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:15.832188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:15.833440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:15.833907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:15.834336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:15.835315 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:15.836219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:15.838623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:15.864176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1203/2384] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:15.867660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:15.894725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094f252-a5b3-482b-841f-0d58959ae4a5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:15.921577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:15.922820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:15.923327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:15.923724 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:15.924726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:15.927285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:15.982453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1182/2385] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:15 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:15.988226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.000529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc004d6-4fd0-4a7b-a272-7518691c5d97 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.077036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.078077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.078463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.078969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.079919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.081957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.111641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1204/2386] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:15 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:16.115772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.130909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13d85f-24dc-4eb3-bfd5-38d44d290252 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.136162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.136778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.137696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.137975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.138642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.140258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.153072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1183/2387] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:16.157240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.169521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e58bf-a74c-434e-a57b-5e54bc08a67f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.174614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.175230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.175510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.175866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.176452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.178136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33b3c-5c13-4d30-9f63-e7738ddba312 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.190797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1205/2388] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:16.196947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.208717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbb54-8dd7-404b-b900-422dadfb03cf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.213842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.214608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.214966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.215293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] PATH_INFO: `/v3/projects/0b432b5d4a544fb7a08aee65000bcea8/users/4ced26a02c1a4a1eb66baca8cb348111/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.233368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b432b5d4a544fb7a08aee65000bcea8, user_id=4ced26a02c1a4a1eb66baca8cb348111, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.235933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.251718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1184/2389] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:16 2022] PUT /identity/v3/projects/0b432b5d4a544fb7a08aee65000bcea8/users/4ced26a02c1a4a1eb66baca8cb348111/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:16.265142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.265575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.266307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.308471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] MFA Rules not processed for user `4ced26a02c1a4a1eb66baca8cb348111`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:16.310083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:16.398253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1206/2390] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:16.403950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.423350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:16.506687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379cd7-a208-4a36-9625-98bb21d780b4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.512064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.512719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.513016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.513292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.513976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.516039 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.552223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1185/2391] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:16 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:16.557248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.569001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1db48-fcba-4cea-9455-71fbd2c56428 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.575979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:16.650886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.651417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.651699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.652005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.653150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.655160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.685721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1207/2392] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:16 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:16.690586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.707043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e63b-8f05-4ecc-aa7c-6a8b26626fe5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.712899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.713753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.714146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.714566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.715949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.717641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.734573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1186/2393] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:16.736835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.750087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa90e-1933-41ff-b193-c7111904e04e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.755504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.756328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.756676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.757034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] PATH_INFO: `/v3/projects/00b7952394ad4c5992e195774856785b/users/d3ccb1d151ce4489995568024611fe1c/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.793953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b7952394ad4c5992e195774856785b, user_id=d3ccb1d151ce4489995568024611fe1c, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.797433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.817076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1208/2394] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:16 2022] PUT /identity/v3/projects/00b7952394ad4c5992e195774856785b/users/d3ccb1d151ce4489995568024611fe1c/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:16.821920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.833486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e6862-f37c-4678-802f-721adbc54751 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.925765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.926502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.926787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.927182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.928274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.930340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebcc48-e080-41bc-b4cb-c16292d726ff admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.942082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1187/2395] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:16.947713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:16.962292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca657-85f7-4386-a054-ea0130d2f611 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:16.974559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:16.975876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:16.976986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:16.976986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] PATH_INFO: `/v3/projects/00b7952394ad4c5992e195774856785b/users/d3ccb1d151ce4489995568024611fe1c/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:16.978720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b7952394ad4c5992e195774856785b, user_id=d3ccb1d151ce4489995568024611fe1c, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:16.982204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:16.996443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1209/2396] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:16 2022] PUT /identity/v3/projects/00b7952394ad4c5992e195774856785b/users/d3ccb1d151ce4489995568024611fe1c/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:17.008335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773af1f-989f-4d57-a9c1-4421ed9fa4af None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:17.008680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773af1f-989f-4d57-a9c1-4421ed9fa4af None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:17.009127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773af1f-989f-4d57-a9c1-4421ed9fa4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:17.054545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0773af1f-989f-4d57-a9c1-4421ed9fa4af None None] MFA Rules not processed for user `d3ccb1d151ce4489995568024611fe1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:17.054545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0773af1f-989f-4d57-a9c1-4421ed9fa4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:17.142058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1188/2397] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:17.155204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:17.157265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:17.247257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb666-d21f-4c5c-b8fb-92b6570ebd1b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:17.251430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:17.252293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:17.252574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:17.252851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:17.354246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:17.357083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:17.371935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1210/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:18.190191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:18.190929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:18.190929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:18.205983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:18.214852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:18.216648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:18.277134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1189/2399] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:18.345563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:18.347049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:18.372809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:18.435177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8f984-7dd5-4665-994a-f1f5e02c4337 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:18.441331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:18.441945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:18.442220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:18.442551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:18.463376 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:18.466239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:18.475094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1211/2400] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:20:18.885151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:18.886888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:18.901694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac68b87-7858-4358-9ea2-281ceeb9396f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:18.905901 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:18.906675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:18.906920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:18.907192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:18.920809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:18.920809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e280382-e82d-4b85-8db6-7297c3dec787 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:18.940444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1190/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:23.009534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:23.015265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f73d-cab5-4afb-bb1d-068f0646b302 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.016648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f73d-cab5-4afb-bb1d-068f0646b302 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.020040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f73d-cab5-4afb-bb1d-068f0646b302 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.021986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1191/2402] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:20:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:20:23.056529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db363474-204e-4291-97f8-95ff39ab012e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.056874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db363474-204e-4291-97f8-95ff39ab012e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.057675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db363474-204e-4291-97f8-95ff39ab012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.117355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-db363474-204e-4291-97f8-95ff39ab012e None None] MFA Rules not processed for user `75492a4f8b854a78be8bcf582e4732d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:23.119827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-db363474-204e-4291-97f8-95ff39ab012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:23.120485 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e331b-5a60-437c-ae80-d4160c86830a service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:23.127174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:23.127892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.128238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.128578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] PATH_INFO: `/v3/users/4ced26a02c1a4a1eb66baca8cb348111` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.129802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ced26a02c1a4a1eb66baca8cb348111)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:23.137534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:23.243224 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ced26a02c1a4a1eb66baca8cb348111'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:23.262920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ced26a02c1a4a1eb66baca8cb348111'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:23.264054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ced26a02c1a4a1eb66baca8cb348111'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:23.264705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ced26a02c1a4a1eb66baca8cb348111'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:23.274888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ced26a02c1a4a1eb66baca8cb348111'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:23.297310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1192/2403] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:23.302019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1212/2404] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:23 2022] DELETE /identity/v3/users/4ced26a02c1a4a1eb66baca8cb348111 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:23.308001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.309309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.309642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.313558 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:23.315633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:23.353095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:23.354304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:23.377919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:23.469229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8b89-2341-49f1-ad0e-893bc9143b2c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:23.476552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:23.476552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.477040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.477216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.484890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1193/2405] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:23.490908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:23.493311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:23.502361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:23.504136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:23.511439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1213/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:23.586613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:23.606459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55562-cdc9-4cf8-839e-4598ab96f93c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:23.610889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:23.611825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:23.611825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:23.612606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:23.623647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:23.625642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:23.641417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1194/2407] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:24.019106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:24.022170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:24.058146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84417c-c4d9-4fe3-8915-cc1ca2180b2c service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:24.067279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:24.068125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:24.068397 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:24.069487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] PATH_INFO: `/v3/projects/0b432b5d4a544fb7a08aee65000bcea8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:24.071425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b432b5d4a544fb7a08aee65000bcea8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:24.073883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:24.159722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b432b5d4a544fb7a08aee65000bcea8', 'request_id': 'req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.169020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b432b5d4a544fb7a08aee65000bcea8', 'request_id': 'req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.178767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b432b5d4a544fb7a08aee65000bcea8', 'request_id': 'req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.193753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] The token cache is being invalidate because project 0b432b5d4a544fb7a08aee65000bcea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:24.194227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.194777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.196387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1214/2408] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:24 2022] DELETE /identity/v3/projects/0b432b5d4a544fb7a08aee65000bcea8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:24.200984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:24.217402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6d46-3e48-4ef4-b8b8-546e35730366 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:24.344076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:24.344769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:24.345525 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:24.345862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] PATH_INFO: `/v3/users/d3ccb1d151ce4489995568024611fe1c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:24.347184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ccb1d151ce4489995568024611fe1c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:24.350671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:24.415816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ccb1d151ce4489995568024611fe1c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.428326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ccb1d151ce4489995568024611fe1c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.430362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ccb1d151ce4489995568024611fe1c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.431238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ccb1d151ce4489995568024611fe1c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.452193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-805fb0b1-17c4-42bd-8ebd-feb718eaa808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ccb1d151ce4489995568024611fe1c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:24.472749 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1195/2409] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:24 2022] DELETE /identity/v3/users/d3ccb1d151ce4489995568024611fe1c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:24.826580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:24.828328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:24.849248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b6a9e-f03a-4f07-bd38-5cfe22ca4721 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:24.870386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:24.871356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:24.871635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:24.906322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:24.907783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:24.981697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:24.982683 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:24.983136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:24.983556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] PATH_INFO: `/v3/projects/00b7952394ad4c5992e195774856785b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:24.984899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b7952394ad4c5992e195774856785b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:24.987058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:24.998654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1196/2410] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:20:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:25.011105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.013241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:25.019328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:25.045652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:25.055602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b7952394ad4c5992e195774856785b', 'request_id': 'req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:25.067161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b7952394ad4c5992e195774856785b', 'request_id': 'req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:25.073486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b7952394ad4c5992e195774856785b', 'request_id': 'req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:25.086515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] The token cache is being invalidate because project 00b7952394ad4c5992e195774856785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:25.087013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:25.087727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d0cbdb21-d2f9-4b4b-80c8-86296b7d27ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:25.089300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1215/2411] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:24 2022] DELETE /identity/v3/projects/00b7952394ad4c5992e195774856785b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:25.094307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104cbb-c882-4aa8-b7d4-939852de0074 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.094738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104cbb-c882-4aa8-b7d4-939852de0074 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.095138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104cbb-c882-4aa8-b7d4-939852de0074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.110685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6bcd-2bc3-42c5-be57-f8fc870d7f9c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.119253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4c104cbb-c882-4aa8-b7d4-939852de0074 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:25.121932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4c104cbb-c882-4aa8-b7d4-939852de0074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:25.189802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.190579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1216/2412] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:25.190721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.190721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.191186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.192895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:25.198361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.198699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.199072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.221428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:25.222707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:25.231645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1217/2413] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:25.235866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.245278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc7ed-3bb9-418c-b47d-d1068cc403ac None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.251723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.252638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.253046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.253449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.254136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:25.254439 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.256114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.266540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.267583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.269693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1218/2414] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:20:25.273784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.281882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1197/2415] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:20:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 16:20:25.286175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b721d-7270-481f-874e-5ba76cba7012 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.302645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.303628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.304003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.304373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.305146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.309418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.365891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1219/2416] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:25 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:25.374563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.392341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff27cce-6f15-4e0d-9614-cbbc11f02200 service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.535937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:25.569063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.569977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.570352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.570740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.571468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.573494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.627463 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.635805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1198/2417] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:25 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:25.643026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbebc-3464-43a0-8f18-8cbfecf3b480 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.671358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.672516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.672961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.673311 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.674070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.675868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.699599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.709619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1220/2418] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:25.718232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e896fe-d5de-42db-afa5-a5d5c27e2fbc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.732139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.732774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.733040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.733310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.734353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.736214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278eb28-b0d9-43aa-8f9a-36cfd894995a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.768479 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1199/2419] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:25.770239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:25.788112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dde01-f583-46c1-b4d2-0c2cb3373efd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:25.798821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:25.799600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.799878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.800234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] PATH_INFO: `/v3/projects/7682d4a4ef8e42dab66682f1d8c55682/users/ad0966d2a1524056a05042ad93db81f8/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.855749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7682d4a4ef8e42dab66682f1d8c55682, user_id=ad0966d2a1524056a05042ad93db81f8, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:25.875442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:25.906539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1221/2420] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:25 2022] PUT /identity/v3/projects/7682d4a4ef8e42dab66682f1d8c55682/users/ad0966d2a1524056a05042ad93db81f8/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:25.923273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:25.923550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:25.923868 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:25.965742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] MFA Rules not processed for user `ad0966d2a1524056a05042ad93db81f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:25.967159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:26.132496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1200/2421] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:26.134973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:26.278026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:26.299847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0a39-0039-4677-82fe-be4d071db472 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:26.306131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:26.307081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.310793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.311238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:26.312033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:26.314711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:26.389156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1222/2422] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:26 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:26.391549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:26.411192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d392-b446-4654-95c6-5838eaa7ebb6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:26.547399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:26.551394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.551957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.552230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:26.552999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:26.557262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:26.633500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1201/2423] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:26 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:26.634750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:26.651693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53902b19-b549-4f1e-b721-84d58ed8a30d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:26.669814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:26.686401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.690895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.694597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:26.695465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:26.704113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:26.757949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:26.759671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1223/2424] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:26.774546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad1b54-be89-4d13-91bd-fd6cdedc8368 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:26.782839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:26.786302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.786685 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.787292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:26.789266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:26.791226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192e28f-e752-4d54-b661-58a10d728887 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:26.808483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1202/2425] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:26.821278 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:26.851192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f36d-2cc9-4e47-b2f4-a50f75c615a9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:26.866269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:26.867021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.867349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.867628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] PATH_INFO: `/v3/projects/b7af663f854f412c9171343e282c6736/users/a05d88d65b60499e8cb854bcc6040aff/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:26.912555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af663f854f412c9171343e282c6736, user_id=a05d88d65b60499e8cb854bcc6040aff, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:26.918855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:26.956429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1224/2426] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:26 2022] PUT /identity/v3/projects/b7af663f854f412c9171343e282c6736/users/a05d88d65b60499e8cb854bcc6040aff/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:26.967811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:26.971134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:26.971638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:27.085927 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] MFA Rules not processed for user `a05d88d65b60499e8cb854bcc6040aff`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:27.088361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:27.118269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:27.246839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1203/2427] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:27.247848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:27.426426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d480-305a-4f83-88b7-07346f2492f8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:27.443588 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:27.445490 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:27.446017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:27.446605 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:27.447509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:27.451045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:27.514692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1225/2428] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:27 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:27.516170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:27.543440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9ce1d-49db-4cf7-ba65-9a4d0c7e1445 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:27.722050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:27.723444 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:27.723815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:27.724164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:27.727828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:27.737372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:27.782636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1204/2429] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:27 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:27.786234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:27.803487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e776c-7c55-4995-aca0-fd4f5d44569e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:27.810790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:27.812017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:27.812608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:27.813121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:27.814079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:27.816175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:27.833649 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:27.845850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1226/2430] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:27.848010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc01d0-5f96-4451-8bde-f04b8da852ea admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:27.854470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:27.855610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:27.856088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:27.856573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] PATH_INFO: `/v3/projects/db3981ac16a64057bdeed5254caf0f41/users/1057e8cd907e421798306a5aebbe25d1/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:27.875762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3981ac16a64057bdeed5254caf0f41, user_id=1057e8cd907e421798306a5aebbe25d1, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:27.879743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:27.922253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1205/2431] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:27 2022] PUT /identity/v3/projects/db3981ac16a64057bdeed5254caf0f41/users/1057e8cd907e421798306a5aebbe25d1/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:27.923426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:27.937419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c76-df4c-4281-bb32-787d81be2e4c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:28.054128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:28.054718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:28.054998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:28.055818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:28.055951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:28.057938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895335d-5e22-41d1-8e17-9c840388e074 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:28.085266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:28.085685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1227/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:28.115874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3535d8-6713-4fd6-bcbf-38e778b58c8d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:28.132169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:28.132829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:28.133509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:28.133509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] PATH_INFO: `/v3/projects/db3981ac16a64057bdeed5254caf0f41/users/1057e8cd907e421798306a5aebbe25d1/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:28.136213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3981ac16a64057bdeed5254caf0f41, user_id=1057e8cd907e421798306a5aebbe25d1, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:28.138965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:28.187197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:28.187562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:28.187755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:28.191240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1206/2433] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:28 2022] PUT /identity/v3/projects/db3981ac16a64057bdeed5254caf0f41/users/1057e8cd907e421798306a5aebbe25d1/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:28.223885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:28.239707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] MFA Rules not processed for user `1057e8cd907e421798306a5aebbe25d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:28.241104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:28.441658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1228/2434] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:28.453827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:28.456601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:28.672545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ec98-1d00-4faf-a01b-9f3462fc6a5d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:28.689981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:28.691089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:28.691589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:28.692547 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:28.744497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:28.747446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:28.794395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1207/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:29.434082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:29.435673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:29.520577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:29.523090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:29.572604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3e9bd-709f-45fd-a79b-c6c6bfccb6c6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:29.585443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:29.589164 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:29.591154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:29.593257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:29.593553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:29.604981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:29.626143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:29.628761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:29.665583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1229/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:29.705358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ef5b-0053-4a99-bdad-27dc79b15a1c service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:29.710210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:29.710965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:29.711308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:29.711647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] PATH_INFO: `/v3/users/6d9a94869c5e434ea030773e74cf301b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:29.713392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9a94869c5e434ea030773e74cf301b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:29.718581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:29.826238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:29.826640 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9a94869c5e434ea030773e74cf301b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:29.828546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:29.839341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9a94869c5e434ea030773e74cf301b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:29.840045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9a94869c5e434ea030773e74cf301b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:29.840674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9a94869c5e434ea030773e74cf301b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:29.847119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974f3f-2f71-4445-8612-ee3b08b7a7f5 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:29.851085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:29.851570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:29.851872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:29.852140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:29.854057 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:29.855809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9a94869c5e434ea030773e74cf301b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:29.889965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1208/2437] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:29 2022] DELETE /identity/v3/users/6d9a94869c5e434ea030773e74cf301b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:29.953458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:29.955991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:29.982349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1230/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:30.160611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:30.162861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:30.313361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b2a44-84c1-4770-8c6f-24957f73a123 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:30.324774 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:30.325423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:30.325725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:30.325946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] PATH_INFO: `/v3/projects/4299cfa8307c45a8894057654b1b7dfb` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:30.333652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4299cfa8307c45a8894057654b1b7dfb)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:30.333652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:30.422369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:30.538660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4299cfa8307c45a8894057654b1b7dfb', 'request_id': 'req-7103857f-d250-4c81-93bd-a8c52733c594'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.597996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4299cfa8307c45a8894057654b1b7dfb', 'request_id': 'req-7103857f-d250-4c81-93bd-a8c52733c594'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.612267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4299cfa8307c45a8894057654b1b7dfb', 'request_id': 'req-7103857f-d250-4c81-93bd-a8c52733c594'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.631236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] The token cache is being invalidate because project 4299cfa8307c45a8894057654b1b7dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:30.631236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.631236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.632109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1209/2439] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:30 2022] DELETE /identity/v3/projects/4299cfa8307c45a8894057654b1b7dfb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:30.642166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:30.657155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb7ba6-1249-4534-8cf7-657956e0c79e service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:30.695153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:30.779786 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:30.781583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:30.782300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:30.782798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] PATH_INFO: `/v3/users/774fcc8e904a489b8037621be4aeddec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:30.785038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=774fcc8e904a489b8037621be4aeddec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:30.790252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:30.887608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774fcc8e904a489b8037621be4aeddec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.905273 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774fcc8e904a489b8037621be4aeddec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.905926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774fcc8e904a489b8037621be4aeddec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.906844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774fcc8e904a489b8037621be4aeddec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.934735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774fcc8e904a489b8037621be4aeddec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:30.970158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1231/2440] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:30 2022] DELETE /identity/v3/users/774fcc8e904a489b8037621be4aeddec => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:31.435126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:31.437145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:31.459044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103857f-d250-4c81-93bd-a8c52733c594 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:31.559684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:31.560482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:31.560836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:31.561669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] PATH_INFO: `/v3/projects/11554daef1aa41c6b4a8100182a8ca9d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:31.563423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11554daef1aa41c6b4a8100182a8ca9d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:31.565467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:31.687457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11554daef1aa41c6b4a8100182a8ca9d', 'request_id': 'req-53439e42-c146-449a-b65f-df18c1ab4b59'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:31.702112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11554daef1aa41c6b4a8100182a8ca9d', 'request_id': 'req-53439e42-c146-449a-b65f-df18c1ab4b59'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:31.713758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11554daef1aa41c6b4a8100182a8ca9d', 'request_id': 'req-53439e42-c146-449a-b65f-df18c1ab4b59'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:31.744561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] The token cache is being invalidate because project 11554daef1aa41c6b4a8100182a8ca9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:31.745121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:31.746475 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:31.748665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1210/2441] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:31 2022] DELETE /identity/v3/projects/11554daef1aa41c6b4a8100182a8ca9d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:34.923774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:34.929551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:35.077510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475697-fef1-447b-9143-549e91c24d4f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:35.206011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:35.207597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:35.208604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:35.209398 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:35.212994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:35.232253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:35.335915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:35.340448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593628-3381-4852-b7a5-2238a63a3896 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:35.374196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1232/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:38.287101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:38.288650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:38.376224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:38.382173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439e42-c146-449a-b65f-df18c1ab4b59 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:38.388618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:38.389389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:38.390093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:38.391935 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] PATH_INFO: `/v3/users/ad0966d2a1524056a05042ad93db81f8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:38.395047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0966d2a1524056a05042ad93db81f8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:38.400091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:38.524009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0966d2a1524056a05042ad93db81f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:38.546100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0966d2a1524056a05042ad93db81f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:38.547228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0966d2a1524056a05042ad93db81f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:38.547836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0966d2a1524056a05042ad93db81f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:38.557997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0966d2a1524056a05042ad93db81f8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:38.594040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1211/2443] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:38 2022] DELETE /identity/v3/users/ad0966d2a1524056a05042ad93db81f8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:38.595801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:38.596270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:38.596389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:38.658823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:38.660652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:38.830024 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1233/2444] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:38.842303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:38.844558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:38.969717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d3b8-22c8-4c4e-87be-2fe18b4b9c27 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:38.973650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:38.974270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:38.974579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:38.974847 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:38.987729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:38.989392 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:39.002268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1212/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:39.431568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:39.434025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:39.471678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba225d3-e363-4136-99c8-2c622691bb6f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:39.485063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:39.486068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:39.486696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:39.487243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] PATH_INFO: `/v3/projects/7682d4a4ef8e42dab66682f1d8c55682` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:39.488502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7682d4a4ef8e42dab66682f1d8c55682)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:39.491301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:39.598457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7682d4a4ef8e42dab66682f1d8c55682', 'request_id': 'req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.612906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7682d4a4ef8e42dab66682f1d8c55682', 'request_id': 'req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.620240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7682d4a4ef8e42dab66682f1d8c55682', 'request_id': 'req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.646761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] The token cache is being invalidate because project 7682d4a4ef8e42dab66682f1d8c55682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:39.647671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.649025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.651885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1234/2446] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:39 2022] DELETE /identity/v3/projects/7682d4a4ef8e42dab66682f1d8c55682 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:39.657249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:39.672950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200438-632a-429b-bccf-b4cc56730fda service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:39.748217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:39.749011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:39.749343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:39.749677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] PATH_INFO: `/v3/users/a05d88d65b60499e8cb854bcc6040aff` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:39.751227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05d88d65b60499e8cb854bcc6040aff)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:39.754018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:39.784648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:39.835093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05d88d65b60499e8cb854bcc6040aff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.849686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05d88d65b60499e8cb854bcc6040aff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.850938 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05d88d65b60499e8cb854bcc6040aff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.852522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05d88d65b60499e8cb854bcc6040aff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.867980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05d88d65b60499e8cb854bcc6040aff'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:39.930302 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:39.931896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:39.934403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1213/2447] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:39 2022] DELETE /identity/v3/users/a05d88d65b60499e8cb854bcc6040aff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:39.995157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:40.024997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a7d82-9660-48f8-96f1-ec0a60e20cdc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:40.135283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:40.137159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:40.137846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:40.138624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:40.142071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:40.236968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:40.239395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:40.259375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1235/2448] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:40.363519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:40.366352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:40.407780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d3ea-17cc-431e-b185-70e15dffb740 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:40.413418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:40.414069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:40.414340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:40.414662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] PATH_INFO: `/v3/projects/b7af663f854f412c9171343e282c6736` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:40.415953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7af663f854f412c9171343e282c6736)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:40.417913 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:40.487914 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7af663f854f412c9171343e282c6736', 'request_id': 'req-553bd19b-350a-41d1-b64c-2b09471c3a4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.498755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7af663f854f412c9171343e282c6736', 'request_id': 'req-553bd19b-350a-41d1-b64c-2b09471c3a4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.508080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7af663f854f412c9171343e282c6736', 'request_id': 'req-553bd19b-350a-41d1-b64c-2b09471c3a4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.521766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] The token cache is being invalidate because project b7af663f854f412c9171343e282c6736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:40.522095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.522786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.524648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1214/2449] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:40 2022] DELETE /identity/v3/projects/b7af663f854f412c9171343e282c6736 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:40.528615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:40.540834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf01597-b21a-4e06-a843-5366ccfebaca service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:40.614707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:40.615442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:40.615997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:40.616531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] PATH_INFO: `/v3/users/1057e8cd907e421798306a5aebbe25d1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:40.617952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1057e8cd907e421798306a5aebbe25d1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:40.620052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:40.679652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:40.681213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1057e8cd907e421798306a5aebbe25d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.692246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1057e8cd907e421798306a5aebbe25d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.692952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1057e8cd907e421798306a5aebbe25d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.694747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1057e8cd907e421798306a5aebbe25d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.704082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a108b55a-4000-43d8-93cd-6d0e207ba185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1057e8cd907e421798306a5aebbe25d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:40.726744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1236/2450] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:40 2022] DELETE /identity/v3/users/1057e8cd907e421798306a5aebbe25d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:41.579028 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:41.581261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:41.597956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd19b-350a-41d1-b64c-2b09471c3a4f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:41.682118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:41.683718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:41.684060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:41.684408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] PATH_INFO: `/v3/projects/db3981ac16a64057bdeed5254caf0f41` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:41.685969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3981ac16a64057bdeed5254caf0f41)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:41.688148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:41.735211 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:41.811742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3981ac16a64057bdeed5254caf0f41', 'request_id': 'req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:41.827717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3981ac16a64057bdeed5254caf0f41', 'request_id': 'req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:41.837959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3981ac16a64057bdeed5254caf0f41', 'request_id': 'req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:41.857429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] The token cache is being invalidate because project db3981ac16a64057bdeed5254caf0f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:41.857950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:41.858976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa9e4cb5-6fab-43f6-87c9-43e74b0c257c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:41.861981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1215/2451] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:41 2022] DELETE /identity/v3/projects/db3981ac16a64057bdeed5254caf0f41 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:41.868956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:41.869511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:41.869746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:41.906170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:41.907931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:42.051046 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1237/2452] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:42.059786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.060074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.060387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.105102 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:42.105968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:42.125210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1216/2453] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:42.126391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.137621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87a76-f08c-46ba-aede-f077b85faeab None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.156077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.157029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.157730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.158071 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.158938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:42.159305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.162077 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.176410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1238/2454] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:42.180578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.191965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59649b-1e78-4a0c-945d-c798dd92e833 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.202310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.203284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.203747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.204167 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.205612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.208347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.272474 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1217/2455] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:42.277247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.289203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4f426-47be-425b-9819-dd9673b1053c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.403446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.404162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.404510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.404853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.405576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.407715 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.444243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1239/2456] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:42.449600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.462087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5e3fa-623a-451b-b70d-2e28da865497 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.477990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.479000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.479000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.479252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.480558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.482174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.503190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1218/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:42.505755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.522303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7cd7-7b21-49c7-90ec-49db801b0e02 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.528527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.528527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.528848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.529152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.529883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.531607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca63e-4f2c-4805-a7f7-4f773f2a7c5b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.548127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1240/2458] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:42.549243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.560882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbe6bf-cd23-40ba-9526-a206bed18bfe admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.574073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.574808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.575079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.575346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] PATH_INFO: `/v3/projects/43c817904293447a97513f96c7e72357/users/2f57db40f6b6492c9005750b71ba4f74/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.593824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c817904293447a97513f96c7e72357, user_id=2f57db40f6b6492c9005750b71ba4f74, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.596515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.613243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1219/2459] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:42 2022] PUT /identity/v3/projects/43c817904293447a97513f96c7e72357/users/2f57db40f6b6492c9005750b71ba4f74/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:42.624626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.624999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.625390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.659073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] MFA Rules not processed for user `2f57db40f6b6492c9005750b71ba4f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:42.661381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:42.680070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:42.752832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1241/2460] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:42.757118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.849007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137ff-a875-4cd1-9133-9af40b28ba85 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:42.854421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:42.855746 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:42.855965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:42.856247 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:42.856878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:42.858890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:42.898657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1220/2461] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:42.902717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:42.916567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f9b3f-cc02-4f62-9a93-771f1dc359ef None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.011718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.012359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.012640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.012912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.013563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.016343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.047992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1242/2462] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:42 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:43.053529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:43.075056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef9c4-e2a8-4df8-a7c6-039608e21752 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.081373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.082290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.083045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.083771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.084861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.093963 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.108932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1221/2463] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:43.113645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:43.126668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cfd55-42cf-40e1-97d7-602234a7048d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.133433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.134147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.134428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.135467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] PATH_INFO: `/v3/projects/b97c8918800a436fbb7a8827e67d0f10/users/19746c3786cb4689a6575521a7346796/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.174279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c8918800a436fbb7a8827e67d0f10, user_id=19746c3786cb4689a6575521a7346796, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.180190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.209969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1243/2464] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:43 2022] PUT /identity/v3/projects/b97c8918800a436fbb7a8827e67d0f10/users/19746c3786cb4689a6575521a7346796/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:43.213818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:43.230308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4cab-ebe9-40e7-be80-1ac1d1e747cd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.255381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:43.311606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.312498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.312760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.313057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.314037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.315725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59008e-a7f9-407b-ae24-e1d8c6d19c57 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.337876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1222/2465] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:43.341756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:43.356197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c4e8-ea53-4402-a967-ce5d965fdab4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.359916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.361132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.361132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.361285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] PATH_INFO: `/v3/projects/b97c8918800a436fbb7a8827e67d0f10/users/19746c3786cb4689a6575521a7346796/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.364276 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c8918800a436fbb7a8827e67d0f10, user_id=19746c3786cb4689a6575521a7346796, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.366943 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.382526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1244/2466] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:43 2022] PUT /identity/v3/projects/b97c8918800a436fbb7a8827e67d0f10/users/19746c3786cb4689a6575521a7346796/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:43.394928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.395234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.395514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.428630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] MFA Rules not processed for user `19746c3786cb4689a6575521a7346796`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:43.429894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:43.539485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1223/2467] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:43.548219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:43.557892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:43.707198 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2c914-f744-451c-b005-1bdcf38db616 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:43.715005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:43.715692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:43.715971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:43.716186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:43.754344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:43.809969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:43.811500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:43.822957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1245/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:45.045560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:45.047737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:45.139391 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b21e9-5881-457c-81ef-a0199ac20e89 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:45.149055 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:45.150010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.150531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.151278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] PATH_INFO: `/v3/users/aa7006ee52de44598022d4326747b427` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.153919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7006ee52de44598022d4326747b427)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:45.156314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:45.213082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:45.215761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7006ee52de44598022d4326747b427'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.226206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7006ee52de44598022d4326747b427'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.226991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7006ee52de44598022d4326747b427'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.227577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7006ee52de44598022d4326747b427'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.236500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-3fd285c8-e8df-43dd-bc34-405a91d402ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7006ee52de44598022d4326747b427'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.257196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1224/2469] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:45 2022] DELETE /identity/v3/users/aa7006ee52de44598022d4326747b427 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:45.486177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:45.498783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411bf0-c5ef-40ca-bb3f-86d1c4c28e85 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:45.612895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:45.613768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.615229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.615547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] PATH_INFO: `/v3/projects/3b23a287fede49b394b363c8efc8870c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.617629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b23a287fede49b394b363c8efc8870c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:45.620332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:45.692555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b23a287fede49b394b363c8efc8870c', 'request_id': 'req-08c49082-20f3-41a7-9280-c85e9953f4a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.705252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b23a287fede49b394b363c8efc8870c', 'request_id': 'req-08c49082-20f3-41a7-9280-c85e9953f4a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.714797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b23a287fede49b394b363c8efc8870c', 'request_id': 'req-08c49082-20f3-41a7-9280-c85e9953f4a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.729205 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] The token cache is being invalidate because project 3b23a287fede49b394b363c8efc8870c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:45.729480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.730517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-08c49082-20f3-41a7-9280-c85e9953f4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:45.734703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1246/2470] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:45 2022] DELETE /identity/v3/projects/3b23a287fede49b394b363c8efc8870c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:45.737285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.737656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.743814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.776839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:45.778366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:45.853302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1225/2471] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:45.862233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.862758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.863068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.893182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:45.894395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:45.902982 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1247/2472] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:45.907600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:45.919147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637f653-5f90-4fef-b2c4-899bcb1bc325 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:45.924422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:45.925036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.925356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.925626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.926395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:45.926653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:45.928287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:45.948254 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1226/2473] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:20:45.952572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:45.963762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15429-b6eb-4466-9ea0-9b806461d006 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:45.968848 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:45.969465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:45.969744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:45.970092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:45.970814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:45.972644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.006564 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1248/2474] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:45 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:46.008807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.019263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b53e89-2d07-4de6-baaf-d5b4048f2e7f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.079662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.080336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.080615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.080883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.081614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.083650 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.108417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1227/2475] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:46.109676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.121993 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838983-73d9-4e0f-98c4-af6bfc11e132 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.127486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.128147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.128423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.128693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.129329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.130986 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6d7d-947c-4ea4-b63a-09ab315b9da6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.141927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1249/2476] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:46.145939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.157616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e90013-6efa-4df6-a6f9-a610563f29a0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.163232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.163736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.164196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.164462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.165193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.167365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.179663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1228/2477] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:46.184379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736bf2-af84-4abd-a06f-cf057fd7b119 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.184514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.184735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736bf2-af84-4abd-a06f-cf057fd7b119 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.184944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736bf2-af84-4abd-a06f-cf057fd7b119 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.186590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1250/2478] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:20:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:20:46.192868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.193228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.193563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.195613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa6f7-3e52-460a-9258-2c2b843cc55b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.200627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.201310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.201581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.201845 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] PATH_INFO: `/v3/projects/588703ae8688400c9c7508abce90d969/users/4f45af7780a543b5a1a9b3d3f7a6c5f9/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.214323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:46.216591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.226079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588703ae8688400c9c7508abce90d969, user_id=4f45af7780a543b5a1a9b3d3f7a6c5f9, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.230262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:46.231923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60541834-b07f-471d-8bd3-d4a7a7588406 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.254210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1229/2479] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:46 2022] PUT /identity/v3/projects/588703ae8688400c9c7508abce90d969/users/4f45af7780a543b5a1a9b3d3f7a6c5f9/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:46.266129 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.266317 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.266610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.277543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:46.301082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1251/2480] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:46.306752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] MFA Rules not processed for user `4f45af7780a543b5a1a9b3d3f7a6c5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:46.308316 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.312410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.314119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.379921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd6440-0705-44d8-9814-223688aeab60 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.398718 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1230/2481] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:46.403647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.434541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.435450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.435730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.436002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.467361 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb542-e7da-44d2-8618-cf6ae077b080 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.472104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.472705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.472973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.473267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.473877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.475783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.503519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1231/2482] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:46.505852 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.507404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959df66-a735-4c48-a8d3-9767b4728d34 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.507645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.518403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1252/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:46.578505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81d76-912a-45a4-8bf5-0975abc60a9e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.584147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.584885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.585163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.585435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.586063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.588011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.592730 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af5e-ccc3-4da8-a20c-41b3be85fb99 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.593304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af5e-ccc3-4da8-a20c-41b3be85fb99 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.593513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af5e-ccc3-4da8-a20c-41b3be85fb99 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.595341 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1253/2484] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:20:46.601612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.601900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.602156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.611947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:46.613833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1232/2485] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:46.619441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.625364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] MFA Rules not processed for user `1d6d914a7228452d960c12c0d5db44aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:46.627457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.630677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa19e-6d6c-40c2-a666-9f980f15dc4a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.639703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.640318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.640592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.640860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.641508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.643208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.645885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:46.658763 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1233/2486] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:46.659615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.661427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.675862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad23d6-a83a-4b2c-b2d5-44e98ac1e4ab admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.680526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.681143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.681422 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.681711 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] PATH_INFO: `/v3/users/2f57db40f6b6492c9005750b71ba4f74` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.682984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f57db40f6b6492c9005750b71ba4f74)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.684897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.690227 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1254/2487] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:46.691160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.702632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e3ea-fad3-44d6-b99f-cff2a350c142 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.707330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.707988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.708336 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.708616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] PATH_INFO: `/v3/projects/8c6193b17ac847779b3472ba7e35599e/users/b61adcbdde584dc1b311084d0de473b5/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.724974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6193b17ac847779b3472ba7e35599e, user_id=b61adcbdde584dc1b311084d0de473b5, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.727867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.742680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1255/2488] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:46 2022] PUT /identity/v3/projects/8c6193b17ac847779b3472ba7e35599e/users/b61adcbdde584dc1b311084d0de473b5/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:46.745947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f57db40f6b6492c9005750b71ba4f74'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:46.746061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.746061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.750493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f57db40f6b6492c9005750b71ba4f74'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:46.751120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f57db40f6b6492c9005750b71ba4f74'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:46.751735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f57db40f6b6492c9005750b71ba4f74'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:46.759010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f57db40f6b6492c9005750b71ba4f74'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:46.779393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1234/2489] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:46 2022] DELETE /identity/v3/users/2f57db40f6b6492c9005750b71ba4f74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:46.779994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.781329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.810309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffa6b6-f080-4893-bca2-8e353951f529 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.850413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daad33-11e3-4db6-a51c-554c24be100a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.856019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.856625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.856903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.857176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.857815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.859453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a40e5-ce3a-447a-98dd-7dc1abf3a5a1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.863239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.863855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.864136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.864413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.866716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.870233 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1235/2490] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:46.871631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.871903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.872173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.877598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.879128 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.888275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1256/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:46.891949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.892803 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:46.894209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.907830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1236/2492] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:46.908692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731009-213e-497a-b8ed-7bc77d2652fe service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.914495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:46.915233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.915574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.915913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] PATH_INFO: `/v3/projects/8c6193b17ac847779b3472ba7e35599e/users/b61adcbdde584dc1b311084d0de473b5/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.918300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6193b17ac847779b3472ba7e35599e, user_id=b61adcbdde584dc1b311084d0de473b5, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:46.921158 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0a651-284f-4479-832d-4681e052f4d3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:46.922183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:46.923859 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:46.937394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6ce9-7a03-464e-a47c-f2c1d2487715 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:46.938549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1257/2493] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:46 2022] PUT /identity/v3/projects/8c6193b17ac847779b3472ba7e35599e/users/b61adcbdde584dc1b311084d0de473b5/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:46.949027 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87e5dd-1346-4f2f-a0f8-56cf12fe2a4d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:46.949365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87e5dd-1346-4f2f-a0f8-56cf12fe2a4d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:46.949637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87e5dd-1346-4f2f-a0f8-56cf12fe2a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:46.987874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ed87e5dd-1346-4f2f-a0f8-56cf12fe2a4d None None] MFA Rules not processed for user `b61adcbdde584dc1b311084d0de473b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:46.989148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ed87e5dd-1346-4f2f-a0f8-56cf12fe2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.020454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:47.022810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.023586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.024085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.024625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.044569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:47.084399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1258/2494] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:47.085963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.086246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.086542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.096698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1259/2495] 10.222.0.27 () {54 vars in 921 bytes} [Mon Sep 19 16:20:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:20:47.098000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.100517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.123163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.124608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfdb68-aa2a-4629-935a-2ea8b84e1f85 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.138143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1237/2496] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:47.139865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.140150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.140523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.166027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] MFA Rules not processed for user `6fe2a726da0f429ba1de83b2ff0ea950`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:47.167389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.184002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3921fa-06e9-4a16-9942-37a02cea27b2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.187983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.188784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.188934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.189239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.203777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.205590 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.219372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1260/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:47.280094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1238/2498] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Sep 19 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:47.300905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.302639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.322150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1523d-51e3-46b3-8ffc-7085acc63986 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.329632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.331212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.331505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.331911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.348324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.349778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315547c-cdab-48a2-a75d-b1e755eaa73f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.363711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1261/2499] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:47.387049 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.398017 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20df11-56f1-48a5-b27e-d0a8fb361b7d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.402864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.404178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.404178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.404394 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] PATH_INFO: `/v3/users/4f45af7780a543b5a1a9b3d3f7a6c5f9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.405522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f45af7780a543b5a1a9b3d3f7a6c5f9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.407570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.472554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f45af7780a543b5a1a9b3d3f7a6c5f9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.484423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f45af7780a543b5a1a9b3d3f7a6c5f9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.485187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f45af7780a543b5a1a9b3d3f7a6c5f9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.486546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f45af7780a543b5a1a9b3d3f7a6c5f9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.497929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f45af7780a543b5a1a9b3d3f7a6c5f9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.527276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1239/2500] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:47 2022] DELETE /identity/v3/users/4f45af7780a543b5a1a9b3d3f7a6c5f9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:47.529722 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.530739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.531230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.562504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:47.564026 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.638177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.643420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.680585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1262/2501] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:47.685322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:47.691390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.692830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:47.765905 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc869cb-a561-4987-a921-2b461c1c2a69 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.770383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.771323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.771754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.771885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.778978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:47.784585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.785756 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3d9f2-48ca-4ec9-8678-b88a569abdf4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.786921 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.796314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.797114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.798166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.798541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] PATH_INFO: `/v3/projects/43c817904293447a97513f96c7e72357` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.799350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1263/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:20:47.800406 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c817904293447a97513f96c7e72357)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:47.802425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:47.863691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c817904293447a97513f96c7e72357', 'request_id': 'req-88efd126-a499-4f9f-bf71-b0d51e3103c9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.873854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c817904293447a97513f96c7e72357', 'request_id': 'req-88efd126-a499-4f9f-bf71-b0d51e3103c9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.882837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c817904293447a97513f96c7e72357', 'request_id': 'req-88efd126-a499-4f9f-bf71-b0d51e3103c9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.897662 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] The token cache is being invalidate because project 43c817904293447a97513f96c7e72357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:47.898109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.898831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:47.900366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1240/2503] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:47 2022] DELETE /identity/v3/projects/43c817904293447a97513f96c7e72357 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:47.905371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:47.917718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f2e99-3148-4075-b295-4d3d749e79ec service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:47.995674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:47.996330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:47.996602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:47.996872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] PATH_INFO: `/v3/users/19746c3786cb4689a6575521a7346796` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:47.998080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19746c3786cb4689a6575521a7346796)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:48.000059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:48.065405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19746c3786cb4689a6575521a7346796'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.075294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19746c3786cb4689a6575521a7346796'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.075948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19746c3786cb4689a6575521a7346796'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.076566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19746c3786cb4689a6575521a7346796'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.086788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19746c3786cb4689a6575521a7346796'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.115729 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1264/2504] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:47 2022] DELETE /identity/v3/users/19746c3786cb4689a6575521a7346796 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:48.133873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:48.136480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:48.192639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd126-a499-4f9f-bf71-b0d51e3103c9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:48.345528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:48.346177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:48.347596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:48.347596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] PATH_INFO: `/v3/projects/588703ae8688400c9c7508abce90d969` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:48.349260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588703ae8688400c9c7508abce90d969)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:48.351594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:48.454083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:48.466994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588703ae8688400c9c7508abce90d969', 'request_id': 'req-03d1303e-eeaa-4b0b-974f-2cab9072e433'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.477356 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588703ae8688400c9c7508abce90d969', 'request_id': 'req-03d1303e-eeaa-4b0b-974f-2cab9072e433'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.491625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588703ae8688400c9c7508abce90d969', 'request_id': 'req-03d1303e-eeaa-4b0b-974f-2cab9072e433'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.513110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] The token cache is being invalidate because project 588703ae8688400c9c7508abce90d969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:48.513471 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.514065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.519036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1241/2505] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:48 2022] DELETE /identity/v3/projects/588703ae8688400c9c7508abce90d969 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:48.519937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:48.521492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:48.547839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bc8b-2a26-4df8-8fa4-87a20abfc659 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:48.628669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:48.633526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:48.649438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:48.650188 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:48.650594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:48.652501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] PATH_INFO: `/v3/users/b61adcbdde584dc1b311084d0de473b5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:48.655645 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61adcbdde584dc1b311084d0de473b5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:48.673427 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:48.713234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:48.752152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1303e-eeaa-4b0b-974f-2cab9072e433 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:48.757579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:48.758236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:48.758535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:48.758811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] PATH_INFO: `/v3/projects/b97c8918800a436fbb7a8827e67d0f10` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:48.760114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97c8918800a436fbb7a8827e67d0f10)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:48.762936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:48.787592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61adcbdde584dc1b311084d0de473b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.809559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61adcbdde584dc1b311084d0de473b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.810110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61adcbdde584dc1b311084d0de473b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.810849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61adcbdde584dc1b311084d0de473b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.819340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b30d8759-9daf-46ae-be5c-b6d0c1337d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61adcbdde584dc1b311084d0de473b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.849380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1265/2506] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:48 2022] DELETE /identity/v3/users/b61adcbdde584dc1b311084d0de473b5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:48.862902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97c8918800a436fbb7a8827e67d0f10', 'request_id': 'req-9164dad7-2e9d-4233-ac26-f85cc8f9030b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.882732 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97c8918800a436fbb7a8827e67d0f10', 'request_id': 'req-9164dad7-2e9d-4233-ac26-f85cc8f9030b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.892381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97c8918800a436fbb7a8827e67d0f10', 'request_id': 'req-9164dad7-2e9d-4233-ac26-f85cc8f9030b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.907342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] The token cache is being invalidate because project b97c8918800a436fbb7a8827e67d0f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:48.907637 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.908284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9164dad7-2e9d-4233-ac26-f85cc8f9030b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:48.910031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1242/2507] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:48 2022] DELETE /identity/v3/projects/b97c8918800a436fbb7a8827e67d0f10 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:48.917199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:48.917488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:48.917801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:48.950806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:48.952155 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.059156 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1266/2508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:49.066851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.067151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.067409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.088903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:49.090172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.098931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1243/2509] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:49.103299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.114554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a1b1-5d95-49e8-9524-179769bc3e56 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.120549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.121265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.121573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.121913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.122675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:49.123064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.124726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.138784 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1267/2510] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:49.143252 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.157434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f3d8-50b5-4db2-b6cb-e8effcd127dd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.164745 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.167861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.174347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.176669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.177430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.181415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.197065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.199413 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.224266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8851b4-b1b3-4347-b59a-4f5c9133880c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.226952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1244/2511] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:49.229993 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.275278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:49.295151 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.295788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.296087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.296359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] PATH_INFO: `/v3/projects/8c6193b17ac847779b3472ba7e35599e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.297538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6193b17ac847779b3472ba7e35599e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.299512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.308277 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58e64-c277-440c-8533-791cd459ef1a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.314695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.315937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.316695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.317440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.319215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.322182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.324632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:49.350996 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1245/2512] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:49.358825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.366528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6193b17ac847779b3472ba7e35599e', 'request_id': 'req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:49.371799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532e224-c866-4477-9cff-590b24f3328e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.375375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6193b17ac847779b3472ba7e35599e', 'request_id': 'req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:49.383114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6193b17ac847779b3472ba7e35599e', 'request_id': 'req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:49.396152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] The token cache is being invalidate because project 8c6193b17ac847779b3472ba7e35599e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:49.396449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:49.397104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c3a0ac5-4c63-4348-a51c-3b12ebe79636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:49.398906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1268/2513] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:49 2022] DELETE /identity/v3/projects/8c6193b17ac847779b3472ba7e35599e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:49.403863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944c0f-8939-4ff5-9717-fb3e9aa0aed9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.404143 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944c0f-8939-4ff5-9717-fb3e9aa0aed9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.404414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944c0f-8939-4ff5-9717-fb3e9aa0aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.425494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-20944c0f-8939-4ff5-9717-fb3e9aa0aed9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:49.426800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-20944c0f-8939-4ff5-9717-fb3e9aa0aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.440405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.441100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.441596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.441720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.442945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.444110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.454879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1246/2514] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:49.459125 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.462083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.481117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45264-c2f1-455d-b411-6fa8c1ad1e57 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.485862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.487144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.487144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.487144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.487813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.489515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.492159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1269/2515] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:49.499662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.499932 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.500201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.501032 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1247/2516] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:49.505144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.516841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60ddea-fa6b-472e-96fc-4286faf44274 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.522509 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.523182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.523507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.523821 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] PATH_INFO: `/v3/projects/135d132dd537474785e4684d9776d5c0/users/f38327e2b16b4b59876dd32173480134/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.524422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:49.525822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.534984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1270/2517] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:49.539560 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.546708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135d132dd537474785e4684d9776d5c0, user_id=f38327e2b16b4b59876dd32173480134, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.549351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2536-c80f-40e1-888c-5f7c9c95a6c2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.551043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a64a30-5e7e-48d2-8874-c3125abb7449 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.556698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.557335 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.557611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.557927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.558686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:49.558985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.560596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.564797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1248/2518] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:49 2022] PUT /identity/v3/projects/135d132dd537474785e4684d9776d5c0/users/f38327e2b16b4b59876dd32173480134/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:49.570460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.571272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.571272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.578323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1271/2519] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:20:49.579629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.591399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45254-4e46-4b20-ae65-e50836f66c7f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.591738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:49.592968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.669867 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.670506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.670861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.671135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.671959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.674075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.674447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1249/2520] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:49.692759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.704967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.750226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1272/2521] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:49.753755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:49.756183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.788074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:49.805050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c4437-ac4b-41fd-bcc9-73ead536ddcd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.843220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1504b-3ed3-414d-8726-da16b525c707 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.849405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.850087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.850430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.850923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.851617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.854152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.858972 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.859759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.859994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.860429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.870890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.872431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60996182-928d-45cf-9a1e-c26aca3c9a28 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.879011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1273/2522] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:49.879892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.881617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.885147 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1250/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:49.887335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.887822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.888580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.917292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d1321-b9dd-49d4-8b54-a7b09d627e32 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.923298 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.924104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.924557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.924984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.927002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.930568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:49.933616 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:49.942658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.944453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.955853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1274/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:49.956749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:49.968256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fab04e-3ed4-40da-8d86-9041a3e01ff9 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:49.974677 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:49.975321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:49.976052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:49.976337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:49.980500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:49.982453 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:49.995672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1275/2525] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:49.999686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.013732 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe24cb-be3d-4756-a4d5-89da88aa5d0e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.019814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.020531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.020880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.021241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.021897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.022937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1251/2526] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:50.023572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.039957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.041599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:50.048114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1276/2527] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:50.054892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.079252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce248976-bfa7-4b51-91a1-33ea25ee49f0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.086951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.087924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.088250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.088571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] PATH_INFO: `/v3/projects/af629fa1e5aa4915bab4cb6334c12d30/users/7878b6cef6ad4c2dab7834ca15aaa1f6/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.110089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af629fa1e5aa4915bab4cb6334c12d30, user_id=7878b6cef6ad4c2dab7834ca15aaa1f6, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.113998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f2249-72d8-4e97-bb28-2587cb8060f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.133250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1277/2528] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:50 2022] PUT /identity/v3/projects/af629fa1e5aa4915bab4cb6334c12d30/users/7878b6cef6ad4c2dab7834ca15aaa1f6/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:50.145084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.145576 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.145874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.150074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd6aa-dec7-404d-8a33-9261bf9ae38d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.178115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] MFA Rules not processed for user `7878b6cef6ad4c2dab7834ca15aaa1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:50.179440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:50.187696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:50.230302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.231164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.231514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.231882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.262958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1278/2529] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:50.269767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.325437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.334146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.340572 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:50.350855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1252/2530] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 16:20:50.390435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf64e7-8b04-41ef-8cde-320cc57ff6bd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.396901 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.397549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.397821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.398964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.400055 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.403291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.482871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1279/2531] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:50 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:50.487544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.501455 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc588-8d48-4678-8524-9502d0cdcaef service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.600280 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.601082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.601435 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.602210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.607107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.611884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.649889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1253/2532] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:50 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:50.655116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.676269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1b8f-b83a-4063-8d34-8f0bfd46e3f2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.685985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.687483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.687766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.687968 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.688952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.692045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.719212 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.722780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1280/2533] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:50.736491 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e0b8-a436-4f4b-80ac-e2fa836523eb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:50.743196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:50.744160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:50.746037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:50.746565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] PATH_INFO: `/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866/users/f4e24de62c3b4f2db8857174679b0a94/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:50.789380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ae5cdeec104c98a4f72a3b8963b866, user_id=f4e24de62c3b4f2db8857174679b0a94, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:50.804335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:50.850661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1254/2534] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:50 2022] PUT /identity/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866/users/f4e24de62c3b4f2db8857174679b0a94/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:50.851195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:50.873858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4d230-b662-401c-b52a-4213b95e7891 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:51.011225 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:51.012120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:51.012580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:51.013010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:51.013818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:51.016138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49813af-9c10-48d8-acfc-71dff381ecd9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:51.040599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1281/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:51.045714 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:51.062607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc613-ed9b-4d0c-9e45-c3ee8b18cc84 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:51.069348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:51.071250 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:51.071772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:51.072397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] PATH_INFO: `/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866/users/f4e24de62c3b4f2db8857174679b0a94/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:51.076022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ae5cdeec104c98a4f72a3b8963b866, user_id=f4e24de62c3b4f2db8857174679b0a94, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:51.080343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:51.096597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1255/2536] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:51 2022] PUT /identity/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866/users/f4e24de62c3b4f2db8857174679b0a94/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:51.107454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:51.107963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:51.108083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:51.144271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] MFA Rules not processed for user `f4e24de62c3b4f2db8857174679b0a94`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:51.145475 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:51.333946 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1282/2537] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:51.346260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:51.348772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:51.448994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:51.545437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe477-484a-4bcf-807f-f86cc61d05e9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:51.558631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:51.560270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:51.560553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:51.562372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:51.596511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:51.603098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162db413-cdcd-4963-aa85-a67de89eb8a1 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:51.653387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1256/2538] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:52.477166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:52.540008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:52.611985 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60396db-9f3e-407a-b9eb-e4d57d122320 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:52.618388 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:52.619725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:52.620340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:52.620618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] PATH_INFO: `/v3/users/7878b6cef6ad4c2dab7834ca15aaa1f6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:52.622210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7878b6cef6ad4c2dab7834ca15aaa1f6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:52.624206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:52.725239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7878b6cef6ad4c2dab7834ca15aaa1f6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:52.746544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7878b6cef6ad4c2dab7834ca15aaa1f6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:52.746544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7878b6cef6ad4c2dab7834ca15aaa1f6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:52.746544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7878b6cef6ad4c2dab7834ca15aaa1f6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:52.766569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7878b6cef6ad4c2dab7834ca15aaa1f6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:52.826285 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1283/2539] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:52 2022] DELETE /identity/v3/users/7878b6cef6ad4c2dab7834ca15aaa1f6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:52.828675 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:52.829218 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:52.829452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:52.908195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:52.910173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:53.037103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1257/2540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:53.065567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:53.068534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:53.203840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480090e-fe43-43cc-a1ea-7d4d8c2efa3d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:53.211906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:53.212939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:53.214897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:53.215415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:53.236734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:53.240613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:53.267300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1284/2541] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:20:54.989687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:54.991124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:55.039784 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8701492-08f2-4e1a-b766-ac54e934dff7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:55.075223 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:55.078194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:55.078713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:55.079229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] PATH_INFO: `/v3/projects/af629fa1e5aa4915bab4cb6334c12d30` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:55.082736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af629fa1e5aa4915bab4cb6334c12d30)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:55.087077 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:55.196395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af629fa1e5aa4915bab4cb6334c12d30', 'request_id': 'req-529274d6-d466-4993-984e-15aaeadb28a5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.216623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af629fa1e5aa4915bab4cb6334c12d30', 'request_id': 'req-529274d6-d466-4993-984e-15aaeadb28a5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.235494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af629fa1e5aa4915bab4cb6334c12d30', 'request_id': 'req-529274d6-d466-4993-984e-15aaeadb28a5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.261535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] The token cache is being invalidate because project af629fa1e5aa4915bab4cb6334c12d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:55.261832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.262542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.264090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1258/2542] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:54 2022] DELETE /identity/v3/projects/af629fa1e5aa4915bab4cb6334c12d30 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:55.269771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:55.284293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b244-5d9b-4762-9ff6-ec2ccc094a40 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:55.399676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:55.417526 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:55.419799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:55.420666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:55.420948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] PATH_INFO: `/v3/users/f4e24de62c3b4f2db8857174679b0a94` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:55.426899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e24de62c3b4f2db8857174679b0a94)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:55.432135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:55.546289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e24de62c3b4f2db8857174679b0a94'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.558926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e24de62c3b4f2db8857174679b0a94'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.559557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e24de62c3b4f2db8857174679b0a94'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.560179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e24de62c3b4f2db8857174679b0a94'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.577697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7cbdda14-3288-4648-96a8-04aef06eb251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e24de62c3b4f2db8857174679b0a94'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:55.655897 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1285/2543] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:55 2022] DELETE /identity/v3/users/f4e24de62c3b4f2db8857174679b0a94 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:57.083359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:57.090069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:57.128553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529274d6-d466-4993-984e-15aaeadb28a5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:57.230687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:57.270663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:57.272177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.295132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.295884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] PATH_INFO: `/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.298281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ae5cdeec104c98a4f72a3b8963b866)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:57.301064 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:57.423160 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ae5cdeec104c98a4f72a3b8963b866', 'request_id': 'req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.436851 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ae5cdeec104c98a4f72a3b8963b866', 'request_id': 'req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.444460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ae5cdeec104c98a4f72a3b8963b866', 'request_id': 'req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.486936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] The token cache is being invalidate because project d1ae5cdeec104c98a4f72a3b8963b866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:57.488988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.490987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.493086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1259/2544] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:57 2022] DELETE /identity/v3/projects/d1ae5cdeec104c98a4f72a3b8963b866 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:57.498712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bf15-a2e3-4616-a31a-412bdafd47db None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.499245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bf15-a2e3-4616-a31a-412bdafd47db None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.499536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bf15-a2e3-4616-a31a-412bdafd47db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.552850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c888bf15-a2e3-4616-a31a-412bdafd47db None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:57.560656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c888bf15-a2e3-4616-a31a-412bdafd47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:57.569075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:57.571368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:57.725452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1286/2545] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:57.735154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.735444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.735721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.740346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150af6b-bbec-4bd8-906f-12d1ea3a2a41 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:57.762318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:57.763018 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.763294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.764114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] PATH_INFO: `/v3/users/a11490d644a6482689eb26dd6fe965dd` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.765231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11490d644a6482689eb26dd6fe965dd)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:57.767405 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:57.781458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:57.785994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:57.809648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1287/2546] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:57.814699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:57.839936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d31778-601d-44e0-850f-492e8f97e99d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:57.852516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:57.853154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.853435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.854387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.855103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:57.855456 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:57.867671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:57.873377 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11490d644a6482689eb26dd6fe965dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.887414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11490d644a6482689eb26dd6fe965dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.888158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11490d644a6482689eb26dd6fe965dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.888922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11490d644a6482689eb26dd6fe965dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.891617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:20:57.896587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:57.898527 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:57.910604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11490d644a6482689eb26dd6fe965dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:57.924250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b42fa-baf9-444f-bcad-ae5cba1d0ca7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:57.935210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:57.935746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:57.936025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:57.936296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:57.936936 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:57.939114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:57.961339 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1260/2548] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:20:57 2022] DELETE /identity/v3/users/a11490d644a6482689eb26dd6fe965dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:58.031222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1289/2549] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:57 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:20:58.033301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.039433 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:58.242684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212ee-8d79-4377-b113-e63828f41599 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.412700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.414512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.415574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.416713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.418139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.422595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.484101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.487531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:58.496237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1261/2550] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:58 2022] POST /identity/v3/users => generated 279 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:58.499909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.518401 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caec9-b52a-4509-9887-1a65d6c819a3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.525198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f1748-6f82-4375-9302-ea6726270e0d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.532888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.534196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.534699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.535386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.537290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.539426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.540803 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.541507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.541788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.542065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] PATH_INFO: `/v3/projects/331102772f124e559c136a0e0b75fcf7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.547440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331102772f124e559c136a0e0b75fcf7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.550333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.565447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1262/2551] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:20:58.570236 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.593652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:58.613535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afb5e-15da-4d81-975d-bd6250a48ad2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.640494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331102772f124e559c136a0e0b75fcf7', 'request_id': 'req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:58.662628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331102772f124e559c136a0e0b75fcf7', 'request_id': 'req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:58.681568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331102772f124e559c136a0e0b75fcf7', 'request_id': 'req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:58.713294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] The token cache is being invalidate because project 331102772f124e559c136a0e0b75fcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:20:58.713799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:58.716839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ca78e65b-aa24-4926-aeed-b5418cc6bcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:20:58.722049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1290/2552] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:20:58 2022] DELETE /identity/v3/projects/331102772f124e559c136a0e0b75fcf7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:20:58.727768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ad3-bbcf-4c11-8fee-6f9583c0cb06 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.727768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ad3-bbcf-4c11-8fee-6f9583c0cb06 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.727768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ad3-bbcf-4c11-8fee-6f9583c0cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.792285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.793507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8b0e8ad3-bbcf-4c11-8fee-6f9583c0cb06 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:58.795076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b0e8ad3-bbcf-4c11-8fee-6f9583c0cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:58.795382 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.796068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.796682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.799482 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.807552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.823996 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1291/2553] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:20:58.840063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.840063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.840063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.841026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1263/2554] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:58.842527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.851861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:58.886700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc62-1eaf-4fc6-8c7e-83085733cbb9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.886959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:58.888211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:58.898227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.898948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.899226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.900225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] PATH_INFO: `/v3/projects/90c9c82290ed47a9a4444e8b0ddd312b/users/33e5e159fa3c4cd1a6d87d10db5d47fe/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.905980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1292/2555] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:58.909247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:58.937738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca506cc5-5ea4-4802-bd69-164a1d503ba0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:58.946459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c9c82290ed47a9a4444e8b0ddd312b, user_id=33e5e159fa3c4cd1a6d87d10db5d47fe, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.951726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:58.954095 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74f9f0-7047-4ef5-b8c1-88cfe3e174f2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.954957 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:58.955248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:58.955750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:58.956577 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:20:58.959567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:58.962686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:58.974879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:58.996990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1264/2556] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:58 2022] PUT /identity/v3/projects/90c9c82290ed47a9a4444e8b0ddd312b/users/33e5e159fa3c4cd1a6d87d10db5d47fe/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:20:59.015258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.016443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1293/2557] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:20:59.016918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.017340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.021853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.072792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a3865-3af2-46ee-bff5-9cde006c931f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.154437 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] MFA Rules not processed for user `33e5e159fa3c4cd1a6d87d10db5d47fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:20:59.171772 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:20:59.281337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.281953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.282231 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.282519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.283150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.285130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.365105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1294/2558] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:59 2022] POST /identity/v3/projects => generated 375 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:59.370069 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.381671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1265/2559] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:20:59.385131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.427309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98b4ed-3a09-499e-be96-cdbe4aba15fa None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.620416 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.621101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.621387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.621657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.622614 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.624666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.633924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088e6e0-4023-417a-9cb5-1295eabf7681 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.656658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.657476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.658109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.658460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.659173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.662177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.683688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1266/2560] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:20:59 2022] POST /identity/v3/projects => generated 355 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:59.687999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.711542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1295/2561] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:59 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:20:59.717747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.734086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:20:59.750125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5de9e6-8369-4128-8912-7de63e4a8610 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.858228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9d25-41d1-40c6-af61-b1bbbd61bfd2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.864382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.865927 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.866228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.866594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.867393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.870435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.888390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.889319 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.889830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.890260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.890785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1296/2562] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:59.891370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.892284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.895549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.912039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b9a2f-8697-489f-bff9-c5ef161e6aaa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.926663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.928691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.929521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.930203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:20:59.932263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:20:59.936765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:20:59.965096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1297/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:20:59.967510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:20:59.983774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962389c-7ab2-4eac-ad0c-58449102f9e3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:20:59.992289 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:20:59.993371 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:20:59.995163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:20:59.996025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] PATH_INFO: `/v3/projects/93609dff24ba432b952367759777f5e7/users/5167bb32f4cf4069bf3612addbda9a8d/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.019552 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1267/2564] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:20:59 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:00.024040 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:00.034178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:00.037409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93609dff24ba432b952367759777f5e7, user_id=5167bb32f4cf4069bf3612addbda9a8d, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.054553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2e69-2c2b-446e-92d4-ad27ecef4016 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:00.055945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705587fc-1c70-4512-92b3-9ae84560c63f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.074364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:00.075747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.076336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.077110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.078908 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.081483 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.088443 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1298/2565] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:20:59 2022] PUT /identity/v3/projects/93609dff24ba432b952367759777f5e7/users/5167bb32f4cf4069bf3612addbda9a8d/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:00.100690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.101110 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.101514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.112709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1268/2566] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:00.116846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:00.153943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbefce1-d1e5-407d-96ff-94dc2aed2d1b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:00.194097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] MFA Rules not processed for user `5167bb32f4cf4069bf3612addbda9a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:00.196718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:00.338754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:00.339610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.339948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.343696 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] PATH_INFO: `/v3/projects/a9fc0fba93804341ab57f16a85b80c3c/users/a4adac5fe32e4248970f5bdc0a3e66c7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.412060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fc0fba93804341ab57f16a85b80c3c, user_id=a4adac5fe32e4248970f5bdc0a3e66c7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.417881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.475111 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1269/2567] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:00 2022] PUT /identity/v3/projects/a9fc0fba93804341ab57f16a85b80c3c/users/a4adac5fe32e4248970f5bdc0a3e66c7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:00.477708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:00.480441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1299/2568] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:00.493965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:00.502668 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:00.623578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfb0ab-0085-46ca-9a70-c76020b97545 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:00.629634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:00.630395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.630755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.631187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.632007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.634534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.645137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:00.656576 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1270/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:00.657727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:00.671392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fca8df-16cc-40e8-8fb0-c67637487438 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:00.671674 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bc3c-6b2c-47a4-a305-3b30f7d85910 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:00.678062 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:00.678844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.679034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.679480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] PATH_INFO: `/v3/projects/a9fc0fba93804341ab57f16a85b80c3c/users/a4adac5fe32e4248970f5bdc0a3e66c7/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.682625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fc0fba93804341ab57f16a85b80c3c, user_id=a4adac5fe32e4248970f5bdc0a3e66c7, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.685485 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e815fc-5d41-4f08-a8b1-54bd36118daf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.702133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1271/2570] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:00 2022] PUT /identity/v3/projects/a9fc0fba93804341ab57f16a85b80c3c/users/a4adac5fe32e4248970f5bdc0a3e66c7/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:00.714074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.714403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.714722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.759272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:00.760429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:00.760708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:00.760983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:00.774035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] MFA Rules not processed for user `a4adac5fe32e4248970f5bdc0a3e66c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:00.779588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:00.871608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:00.873410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:00.890612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1300/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:00.971001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:01.060994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1272/2572] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:01.062781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:01.071652 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:01.251649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b686faa-b520-49df-a351-fbb763ec7493 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:01.279955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:01.417995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:01.444967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:01.449361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:01.453294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:01.454744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:01.482754 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:01.484829 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:01.498050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe874b3-b550-4a4c-9423-c10fe1803bcb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:01.528919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1301/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:01.530850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:01.531556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:01.531844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:01.532092 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] PATH_INFO: `/v3/users/5167bb32f4cf4069bf3612addbda9a8d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:01.538643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5167bb32f4cf4069bf3612addbda9a8d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:01.547853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:01.665292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5167bb32f4cf4069bf3612addbda9a8d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:01.695512 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5167bb32f4cf4069bf3612addbda9a8d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:01.696200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5167bb32f4cf4069bf3612addbda9a8d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:01.696823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5167bb32f4cf4069bf3612addbda9a8d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:01.708546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0ddee430-f213-4d2f-8dd3-9c4e647b1c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5167bb32f4cf4069bf3612addbda9a8d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:01.764261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:01.776825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27f23b-ccac-4b1a-8ab4-ec98ce7fbbaf service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:01.790821 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:01.792349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1273/2574] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:01 2022] DELETE /identity/v3/users/5167bb32f4cf4069bf3612addbda9a8d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:01.793444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:01.794018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:01.797330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:01.800408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ba7a-8834-4578-904b-2da9690dc75f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:01.801021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ba7a-8834-4578-904b-2da9690dc75f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:01.801503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ba7a-8834-4578-904b-2da9690dc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:01.804301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:01.868291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f366ba7a-8834-4578-904b-2da9690dc75f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:01.869753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f366ba7a-8834-4578-904b-2da9690dc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:01.970135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:01.971913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:01.985444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1302/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:21:02.010343 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1274/2576] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:02.021853 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.023358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.111259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b7bd-3d2e-43ce-936b-615e6733c36e service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.117134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.117619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.117976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.127827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:02.165573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] MFA Rules not processed for user `f38327e2b16b4b59876dd32173480134`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:02.167551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.189563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.189563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.189563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.189563 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.197519 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.198895 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.211312 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1303/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:02.260733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1275/2578] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:02.266592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.268250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.294670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72563c-3fdc-41e3-8cfb-d3ff7ce4b255 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.299810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.300434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.300873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.301270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.302082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.304183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.340448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1304/2579] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:02 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:02.344657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.356739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ec63-d74b-490c-a271-aad7a794fd37 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.444682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.445311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.446240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.446240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.446691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.449357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.490546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1276/2580] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:02 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:02.492484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.504016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded26d9d-ce3f-40ca-b26d-092ce3d01735 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.508791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.510092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.510390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.510685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.511340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.512925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.528237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1305/2581] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:02.532736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.548992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bae3c-fb8c-49f9-8f6c-5546667d0882 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.554567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.557271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.564106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.565351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.565905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.566598 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] PATH_INFO: `/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf/users/65b7305dd6594712a87ec82fe54da72b/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.582243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9d18-ac06-4279-889b-5cd259e21ab7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.591907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.592556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.592835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.593098 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] PATH_INFO: `/v3/projects/93609dff24ba432b952367759777f5e7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.595005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93609dff24ba432b952367759777f5e7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.598651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.598831 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42331934dc947dabd90a9e5a8bd5fbf, user_id=65b7305dd6594712a87ec82fe54da72b, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.602385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.608021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:02.618460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1277/2582] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:02 2022] PUT /identity/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf/users/65b7305dd6594712a87ec82fe54da72b/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:02.622384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.661616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93609dff24ba432b952367759777f5e7', 'request_id': 'req-0ab757aa-f1fc-47f0-baf3-47c75679e16e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:02.675258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93609dff24ba432b952367759777f5e7', 'request_id': 'req-0ab757aa-f1fc-47f0-baf3-47c75679e16e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:02.685699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93609dff24ba432b952367759777f5e7', 'request_id': 'req-0ab757aa-f1fc-47f0-baf3-47c75679e16e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:02.710007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] The token cache is being invalidate because project 93609dff24ba432b952367759777f5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:02.710355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:02.711410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0ab757aa-f1fc-47f0-baf3-47c75679e16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:02.714571 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1306/2583] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:02 2022] DELETE /identity/v3/projects/93609dff24ba432b952367759777f5e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:02.720396 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f924-e522-4e86-b5c4-e8b18f347881 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.720893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f924-e522-4e86-b5c4-e8b18f347881 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.721377 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f924-e522-4e86-b5c4-e8b18f347881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.721510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c81-fa9b-428e-9b73-6b0d97442281 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.725919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:02.745004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-46f3f924-e522-4e86-b5c4-e8b18f347881 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:02.746239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-46f3f924-e522-4e86-b5c4-e8b18f347881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.810302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.811148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.811429 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.811707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.812879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.816213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.827702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1278/2584] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:02.836928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:02.840060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.841109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1307/2585] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:02.850831 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.851283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.851787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.860099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574901-2dfe-4a28-9ebe-6631ecd2931c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:02.867976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:02.869558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:02.870038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:02.870599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] PATH_INFO: `/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf/users/65b7305dd6594712a87ec82fe54da72b/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:02.877399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42331934dc947dabd90a9e5a8bd5fbf, user_id=65b7305dd6594712a87ec82fe54da72b, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:02.880710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:02.888049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:02.889781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:02.894962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1279/2586] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:02 2022] PUT /identity/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf/users/65b7305dd6594712a87ec82fe54da72b/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:03.006653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1308/2587] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:03.009631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.029794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f38de-f9f9-47b2-8bca-7fd0add1ba43 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.038571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.039387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.039761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.040134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.041269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:03.041900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.044089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.089539 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1280/2588] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:03.091340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.104841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efac93-de33-48b7-a039-e92c2275e9ff None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.110513 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.111411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.111790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.112308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.112916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.115054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.156323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1309/2589] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:03 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:03.161779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.182372 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84422d0-3561-4052-b24d-5909bd0584a3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.271115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.271968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.272571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.272971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.273710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.276000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.313301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1281/2590] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:03 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:03.315277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.329920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9fbe-d0c4-4f56-b5b3-1e4bc8e3f1b7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.340244 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.340871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.341194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.342381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.343241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.346782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.378350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1310/2591] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:03.379596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.397284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d250-3c90-41f2-b1d7-d6aebed0bb97 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.405168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.406044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.406912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.407358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.408285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.410207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fc9fc-b7c5-4f7c-bedf-d75075fa6763 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.429410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1282/2592] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:03.432369 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.455755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:03.484199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4fe30-01d7-48cc-863f-b72c206ce9b3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.489717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.490567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.490844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.491114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] PATH_INFO: `/v3/projects/ead35f9e992040eea0c8f81a810193de/users/1711273efc03492782e91a3cea15fa0f/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.527283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead35f9e992040eea0c8f81a810193de, user_id=1711273efc03492782e91a3cea15fa0f, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.531002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.548559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1311/2593] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:03 2022] PUT /identity/v3/projects/ead35f9e992040eea0c8f81a810193de/users/1711273efc03492782e91a3cea15fa0f/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:03.559945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674db4f-8651-4368-a066-295ad0376294 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.560486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674db4f-8651-4368-a066-295ad0376294 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.561293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674db4f-8651-4368-a066-295ad0376294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.604390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6674db4f-8651-4368-a066-295ad0376294 None None] MFA Rules not processed for user `1711273efc03492782e91a3cea15fa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:03.605736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6674db4f-8651-4368-a066-295ad0376294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:03.695546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:03.734374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1283/2594] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:03.739966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.828716 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e417e66-a362-4528-bd84-59d86c9e07d2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.835737 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.836399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.836792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.838465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.838465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.841034 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:03.883464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1312/2595] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:03.884071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674db4f-8651-4368-a066-295ad0376294 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:03.902447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674db4f-8651-4368-a066-295ad0376294 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:03.978393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:03.979393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:03.980075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:03.980507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:03.981360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:03.985249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.033602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:04.042331 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1284/2596] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:03 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:04.050662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5779ef-fe2d-4a68-9985-0b2f00ebc7a3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:04.056218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:04.057186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.057671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.058266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.059150 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:04.060977 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.079499 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1313/2597] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:04.084456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:04.099980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f892fa8-2c81-4697-939e-87e592862d64 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:04.106703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:04.107510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.108119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.108880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] PATH_INFO: `/v3/projects/c583b63a7a314b0ead23d2560ba6a79e/users/be061e79e9894443aa71de9f74186cfd/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.126878 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c583b63a7a314b0ead23d2560ba6a79e, user_id=be061e79e9894443aa71de9f74186cfd, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:04.130413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.154573 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1285/2598] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:04 2022] PUT /identity/v3/projects/c583b63a7a314b0ead23d2560ba6a79e/users/be061e79e9894443aa71de9f74186cfd/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:04.155416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:04.171771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf050a-310b-4853-b1f1-48570bfca7f9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:04.263804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:04.264890 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.265167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.265438 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.266082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:04.268242 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440efad-c89c-4be5-a389-718a9a1dd6c5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.285674 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1314/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:04.290122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:04.305484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5eac-7db7-4d88-855f-a706638ce0c6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:04.312002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:04.313053 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.313432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.313770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] PATH_INFO: `/v3/projects/c583b63a7a314b0ead23d2560ba6a79e/users/be061e79e9894443aa71de9f74186cfd/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.316351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c583b63a7a314b0ead23d2560ba6a79e, user_id=be061e79e9894443aa71de9f74186cfd, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:04.320940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.342604 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1286/2600] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:04 2022] PUT /identity/v3/projects/c583b63a7a314b0ead23d2560ba6a79e/users/be061e79e9894443aa71de9f74186cfd/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:04.357522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.357522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.357522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.442931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] MFA Rules not processed for user `be061e79e9894443aa71de9f74186cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:04.444699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:04.515458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:04.589274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1315/2601] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:04.595590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:04.597728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:04.689154 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2646-3bea-4a93-8e2c-a3ddb52dcb1f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:04.693284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:04.694002 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:04.694498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:04.694991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:04.720140 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:04.721760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:04.748453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1287/2602] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:05.396201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:05.407470 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6afa63-f228-429e-9d42-cf391908687b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:05.421422 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be061e79e9894443aa71de9f74186cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c583b63a7a314b0ead23d2560ba6a79e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:05.422334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:05.422559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:05.422813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:05.423528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:05.423797 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:05.425535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:05.447452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1316/2603] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:05.447959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:05.462150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8ef-09fb-4121-bda0-25f1933a38ab service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:05.476595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be061e79e9894443aa71de9f74186cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c583b63a7a314b0ead23d2560ba6a79e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:05.477816 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:05.478983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:05.479467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:05.480561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:05.482767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:05.535079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1288/2604] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:05 2022] POST /identity/v3/projects => generated 354 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:05.544611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:05.571174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3951-f604-408f-8749-15797c0eafc3 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:05.674477 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be061e79e9894443aa71de9f74186cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c583b63a7a314b0ead23d2560ba6a79e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:05.675142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:05.675425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:05.675702 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:05.676370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:05.676704 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:05.678353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:05.713960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1317/2605] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:05.767594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:05.791504 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9ce-4d52-44ef-803a-e3ca91410f54 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:05.802189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be061e79e9894443aa71de9f74186cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c583b63a7a314b0ead23d2560ba6a79e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:05.802929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:05.803208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:05.803480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] PATH_INFO: `/v3/projects/cedff7e268854a1aa5501492b2921649` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:05.804780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cedff7e268854a1aa5501492b2921649)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:05.806794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:05.820593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:05.884630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedff7e268854a1aa5501492b2921649', 'request_id': 'req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:05.905158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedff7e268854a1aa5501492b2921649', 'request_id': 'req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:05.914930 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedff7e268854a1aa5501492b2921649', 'request_id': 'req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:05.935873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] The token cache is being invalidate because project cedff7e268854a1aa5501492b2921649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:05.936389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:05.937400 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4b80e814-3a05-4eb0-94d1-ff9e3bf393da tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:05.945580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1289/2606] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:05 2022] DELETE /identity/v3/projects/cedff7e268854a1aa5501492b2921649 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:06.406467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:06.410052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:06.532078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82e992-46ac-4513-b371-5cfa97f376d1 tempest-VolumeQuotaClassesTest-1800482835 tempest-VolumeQuotaClassesTest-1800482835-project-admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:06.623279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:06.624544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:06.624544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:06.624544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] PATH_INFO: `/v3/users/1711273efc03492782e91a3cea15fa0f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:06.625675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1711273efc03492782e91a3cea15fa0f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:06.631644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:06.638415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:06.699752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1711273efc03492782e91a3cea15fa0f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:06.713714 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1711273efc03492782e91a3cea15fa0f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:06.717997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1711273efc03492782e91a3cea15fa0f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:06.723047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1711273efc03492782e91a3cea15fa0f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:06.733570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1711273efc03492782e91a3cea15fa0f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:06.761406 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1318/2607] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:06 2022] DELETE /identity/v3/users/1711273efc03492782e91a3cea15fa0f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:06.766312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:06.766524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:06.766769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:06.820839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:06.822413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:06.996559 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1290/2608] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:07.006646 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:07.008109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:07.114337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226ae1-87bf-4ea8-9030-ed620eefac90 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:07.124594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:07.127072 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:07.127619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:07.128114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:07.151974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:07.154696 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:07.171324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1319/2609] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:07.656572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:07.659910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:07.689375 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ae48-d762-494b-93ba-69f06cd57479 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:07.696029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:07.696340 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:07.696621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:07.696998 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] PATH_INFO: `/v3/projects/ead35f9e992040eea0c8f81a810193de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:07.698738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead35f9e992040eea0c8f81a810193de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:07.700329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:07.852587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead35f9e992040eea0c8f81a810193de', 'request_id': 'req-e545971d-6e9e-416d-921f-eb1f421972dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:07.898082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead35f9e992040eea0c8f81a810193de', 'request_id': 'req-e545971d-6e9e-416d-921f-eb1f421972dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:07.909296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead35f9e992040eea0c8f81a810193de', 'request_id': 'req-e545971d-6e9e-416d-921f-eb1f421972dd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:07.924341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] The token cache is being invalidate because project ead35f9e992040eea0c8f81a810193de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:07.924744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:07.925863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e545971d-6e9e-416d-921f-eb1f421972dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:07.928553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1291/2610] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:07 2022] DELETE /identity/v3/projects/ead35f9e992040eea0c8f81a810193de => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:07.933331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:07.948662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c03e9-e815-49fe-bd32-f19384e18b0d service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:08.084991 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:08.085995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:08.086324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:08.086872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] PATH_INFO: `/v3/users/be061e79e9894443aa71de9f74186cfd` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:08.088131 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be061e79e9894443aa71de9f74186cfd)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:08.095028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:08.142455 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:08.177328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be061e79e9894443aa71de9f74186cfd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:08.198029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be061e79e9894443aa71de9f74186cfd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:08.199210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be061e79e9894443aa71de9f74186cfd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:08.201491 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be061e79e9894443aa71de9f74186cfd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:08.221192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be061e79e9894443aa71de9f74186cfd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:08.257809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964022-2839-4882-8491-068430464ab7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:08.258097 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964022-2839-4882-8491-068430464ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:08.261411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1320/2611] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:07 2022] DELETE /identity/v3/users/be061e79e9894443aa71de9f74186cfd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:08.261587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964022-2839-4882-8491-068430464ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:08.311641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-90964022-2839-4882-8491-068430464ab7 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:08.317562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-90964022-2839-4882-8491-068430464ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:08.374096 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:08.461022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1292/2612] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:21:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:08.480530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:08.482725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:08.686781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6336-36a9-4c92-893a-7412ae23d298 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:08.706009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:08.715597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:08.717245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:08.718096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:08.743099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:08.744727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf63c5-e151-457f-acbc-a33822ef0725 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:08.757746 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1321/2613] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:21:08.883645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964022-2839-4882-8491-068430464ab7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:08.885638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-90964022-2839-4882-8491-068430464ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:09.028259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964022-2839-4882-8491-068430464ab7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.033350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.034093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.034259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.035815 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] PATH_INFO: `/v3/projects/c583b63a7a314b0ead23d2560ba6a79e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.038909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c583b63a7a314b0ead23d2560ba6a79e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.042350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.169500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c583b63a7a314b0ead23d2560ba6a79e', 'request_id': 'req-b2699ccc-70a2-4730-9229-758a7f73fa73'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:09.203875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c583b63a7a314b0ead23d2560ba6a79e', 'request_id': 'req-b2699ccc-70a2-4730-9229-758a7f73fa73'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:09.221213 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c583b63a7a314b0ead23d2560ba6a79e', 'request_id': 'req-b2699ccc-70a2-4730-9229-758a7f73fa73'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:09.252726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] The token cache is being invalidate because project c583b63a7a314b0ead23d2560ba6a79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:09.253656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:09.255639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2699ccc-70a2-4730-9229-758a7f73fa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:09.260193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1293/2614] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:08 2022] DELETE /identity/v3/projects/c583b63a7a314b0ead23d2560ba6a79e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:09.274054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.275604 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.276083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.319321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:09.320688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:09.402688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1322/2615] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:09.411694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.412081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.412473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.443899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:09.445503 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:09.473473 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1294/2616] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:09.481410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.510255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99230fb5-c0ca-4bd8-83b6-569debe01672 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.524195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.526826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.527566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.528160 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.529468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:09.530126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.539176 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.561984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1323/2617] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:09.567044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.592818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0857a63-fae2-432c-b62e-ece68ee55a75 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.600237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.600852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.601583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.601752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.602622 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.604575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.671889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1295/2618] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:09 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:09.672240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.684362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ccc7-fb87-4051-8428-bf84f404ac0c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.721112 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:09.799423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.800728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.801368 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.801530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.802399 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.804557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.836266 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1324/2619] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:09 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:09.836657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.848511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637db9b-ea3d-4ca2-8435-fc983645d31b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.853300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.853900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.854170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.854436 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.855109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.856743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e3bf-6cbd-442e-bf68-a89ecfc23ec0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.869925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1296/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:09.873448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.889872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c29822-bf08-4777-a704-2b165e42a807 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.898760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.898760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.898760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.898760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.899113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.899113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:09.905695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.906234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.906234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.925382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1325/2621] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:09.925877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:09.946047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f35d71-918f-4f61-9299-ea0b8dd66b6f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:09.956119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:09.958600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] MFA Rules not processed for user `65b7305dd6594712a87ec82fe54da72b`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:09.960087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:09.960464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:09.960832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:09.961194 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] PATH_INFO: `/v3/projects/f9c9c3e95a954521a003247a59dbd35e/users/888ad64b2aac4e9494d0059b4fe9071a/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:09.973806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:09.984749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c9c3e95a954521a003247a59dbd35e, user_id=888ad64b2aac4e9494d0059b4fe9071a, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:09.987681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4b022-51c7-439d-957d-1e4b8a21901b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.010945 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1326/2622] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:09 2022] PUT /identity/v3/projects/f9c9c3e95a954521a003247a59dbd35e/users/888ad64b2aac4e9494d0059b4fe9071a/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:10.024926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.025206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.025633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.075073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] MFA Rules not processed for user `888ad64b2aac4e9494d0059b4fe9071a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:10.076293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:10.094549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1297/2623] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:10.106909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.112625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:10.180468 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1327/2624] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:10.188049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.264946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513b88-9d49-4fdb-a26c-a7bb9f8581b3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.292094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07cd7-a52a-42a0-9406-d2d375d16407 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.297037 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.297738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.297950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.298220 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.298923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.300882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.311738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:10.337801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1328/2625] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:10 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:10.339338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.357543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.358157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.358431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.358748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.360544 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:10.409625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:10.418159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca059-3a7b-40e2-bcc4-82b7f74c73d2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.423085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.423688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.423961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.424232 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.424850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.427522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.428646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.430230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.441112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1298/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:21:10.450195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1329/2627] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:10 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:10.454246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.465156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd564c7-fdda-42a3-98ca-b0168666805f service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.469937 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.470645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.470925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.471194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.471822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.473395 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.483647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1299/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:10.488641 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.500448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647dee1-9886-4323-b6c9-cd8158cb172e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.505494 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.506154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.506432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.506850 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] PATH_INFO: `/v3/projects/95232f31b97c42099076c70d316d1ffb/users/34377cca0a22487f89506b02e8d3437f/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.524272 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95232f31b97c42099076c70d316d1ffb, user_id=34377cca0a22487f89506b02e8d3437f, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.527161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.544056 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1330/2629] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:10 2022] PUT /identity/v3/projects/95232f31b97c42099076c70d316d1ffb/users/34377cca0a22487f89506b02e8d3437f/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:10.548030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.563089 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141776a1-c4fa-4a18-9fab-58b48fcb30d3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.629657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.629885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.630146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.630420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.631087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.632699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d7dbf-11b4-4ada-9107-c9fa285b16f5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.643932 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1300/2630] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:10.648202 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.658591 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aed7eb-8070-4f7d-82d0-9fc21ddd1e01 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.663472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.664117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.664392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.664665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] PATH_INFO: `/v3/projects/95232f31b97c42099076c70d316d1ffb/users/34377cca0a22487f89506b02e8d3437f/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.667120 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95232f31b97c42099076c70d316d1ffb, user_id=34377cca0a22487f89506b02e8d3437f, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.669728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.681134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1331/2631] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:10 2022] PUT /identity/v3/projects/95232f31b97c42099076c70d316d1ffb/users/34377cca0a22487f89506b02e8d3437f/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:10.691991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.692428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.692889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.725521 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] MFA Rules not processed for user `34377cca0a22487f89506b02e8d3437f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:10.727191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:10.817770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1301/2632] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:10.834133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:10.836066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:10.912629 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eef96-4d68-4729-80e0-e33b1a856c87 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:10.917425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:10.918255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:10.918554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:10.918825 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:10.929330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:10.930800 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2f112-71ff-4858-8f6d-6ff7f44d9cff service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:10.942524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1332/2633] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:11.125051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:11.189981 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:11.206041 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05bb94-93eb-4490-82a7-60a560bb1650 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:11.211259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:11.212054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:11.212958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:11.213321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] PATH_INFO: `/v3/users/888ad64b2aac4e9494d0059b4fe9071a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:11.214565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=888ad64b2aac4e9494d0059b4fe9071a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:11.216942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:11.276445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888ad64b2aac4e9494d0059b4fe9071a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:11.287051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888ad64b2aac4e9494d0059b4fe9071a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:11.287787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888ad64b2aac4e9494d0059b4fe9071a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:11.288441 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888ad64b2aac4e9494d0059b4fe9071a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:11.300359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888ad64b2aac4e9494d0059b4fe9071a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:11.326595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1302/2634] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:11 2022] DELETE /identity/v3/users/888ad64b2aac4e9494d0059b4fe9071a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:11.330621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942704-bf40-4896-9760-ab8c38e6c461 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:11.332947 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942704-bf40-4896-9760-ab8c38e6c461 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:11.333653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942704-bf40-4896-9760-ab8c38e6c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:11.376267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ca942704-bf40-4896-9760-ab8c38e6c461 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:11.378195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ca942704-bf40-4896-9760-ab8c38e6c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:11.437684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:11.459058 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1333/2635] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:11.470142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:11.472030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:11.556033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474050a3-2347-41c6-8b79-df0249d1ac9d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:11.562085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:11.562947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:11.563802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:11.564299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:11.580046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:11.582438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:11.596214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1303/2636] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:11.754403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:11.754747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:11.754992 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:11.779317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] MFA Rules not processed for user `f38327e2b16b4b59876dd32173480134`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:11.781139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:11.896279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1334/2637] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:12.053773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:12.056697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:12.075993 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef43fa-1c81-4cc5-be49-2e365efb29d8 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:12.083051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:12.083825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:12.084106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:12.084376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] PATH_INFO: `/v3/projects/f9c9c3e95a954521a003247a59dbd35e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:12.085493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c9c3e95a954521a003247a59dbd35e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:12.087719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:12.148899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c9c3e95a954521a003247a59dbd35e', 'request_id': 'req-cb833df6-b5c9-44a4-96ab-19409b0022e6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.159588 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c9c3e95a954521a003247a59dbd35e', 'request_id': 'req-cb833df6-b5c9-44a4-96ab-19409b0022e6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.168494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c9c3e95a954521a003247a59dbd35e', 'request_id': 'req-cb833df6-b5c9-44a4-96ab-19409b0022e6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.171636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:12.188341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] The token cache is being invalidate because project f9c9c3e95a954521a003247a59dbd35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:12.188645 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.189592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.194621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1304/2638] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:12 2022] DELETE /identity/v3/projects/f9c9c3e95a954521a003247a59dbd35e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:12.196049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:12.207798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134f8b6-fd43-49cc-ba0b-4bf01e81615e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:12.277299 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:12.278095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:12.278448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:12.278822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] PATH_INFO: `/v3/users/34377cca0a22487f89506b02e8d3437f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:12.281012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34377cca0a22487f89506b02e8d3437f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:12.282430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:12.344769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34377cca0a22487f89506b02e8d3437f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.359190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34377cca0a22487f89506b02e8d3437f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.360314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34377cca0a22487f89506b02e8d3437f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.361284 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34377cca0a22487f89506b02e8d3437f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.370049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af2af312-8361-4824-a8b3-0fcbcd4cc3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34377cca0a22487f89506b02e8d3437f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.406089 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1335/2639] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:12 2022] DELETE /identity/v3/users/34377cca0a22487f89506b02e8d3437f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:12.732986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:12.734458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:12.750119 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb833df6-b5c9-44a4-96ab-19409b0022e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:12.822117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:12.822997 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:12.823235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:12.823510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] PATH_INFO: `/v3/projects/95232f31b97c42099076c70d316d1ffb` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:12.824725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95232f31b97c42099076c70d316d1ffb)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:12.826904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:12.925738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95232f31b97c42099076c70d316d1ffb', 'request_id': 'req-5052d0ec-8b4d-430b-a5ef-5204a728129e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.945952 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95232f31b97c42099076c70d316d1ffb', 'request_id': 'req-5052d0ec-8b4d-430b-a5ef-5204a728129e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.957198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95232f31b97c42099076c70d316d1ffb', 'request_id': 'req-5052d0ec-8b4d-430b-a5ef-5204a728129e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.973408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] The token cache is being invalidate because project 95232f31b97c42099076c70d316d1ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:12.973686 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.974350 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5052d0ec-8b4d-430b-a5ef-5204a728129e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:12.976134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1305/2640] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:12 2022] DELETE /identity/v3/projects/95232f31b97c42099076c70d316d1ffb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:12.981127 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:12.983047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:12.983047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.046068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:13.049108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:13.056104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:13.225132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1336/2641] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:13.228943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.229629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.229629 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.257766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:13.260499 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:13.279432 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1306/2642] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:13.284620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.296865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b08e-8d06-4589-bb19-6cb0d6001c31 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.303584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.304113 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.304295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.304565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.305356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:13.307082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.311886 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.331952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1337/2643] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:13.340496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.356296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a2e89-a489-40aa-b828-b74ecf268668 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.383506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.387494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.388656 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.389403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.398946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.420291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.472790 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1307/2644] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:13.474212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.489096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41a44-b5e9-4192-bb45-1572b233be68 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.601203 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.601812 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.602087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.602357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.603121 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.605040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.628138 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1338/2645] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:13 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:13.632183 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.646259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d2ee-cf65-4b2c-8dda-430512b69d64 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.651193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.651840 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.652301 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.652579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.653226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.654924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.670078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1308/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:13.675606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.690424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d6eac-4b3e-4cba-9168-cf255506aa12 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.696327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.697152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.697425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.697698 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.698349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.699987 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da2cc-a3c2-4d6a-9d26-7fb107f35bb7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.859783 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:13.860998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1339/2647] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:13.871184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840b1a-6f0f-4b98-a132-6bc2dfb6fb8e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:13.878627 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:13.879434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.879773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.880101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] PATH_INFO: `/v3/projects/9aa75b6075b5451393af9849beb5c5a8/users/ae8ae93c75144b65bdd29c16064c5aca/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:13.899636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa75b6075b5451393af9849beb5c5a8, user_id=ae8ae93c75144b65bdd29c16064c5aca, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:13.902826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:13.925925 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1309/2648] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:13 2022] PUT /identity/v3/projects/9aa75b6075b5451393af9849beb5c5a8/users/ae8ae93c75144b65bdd29c16064c5aca/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:13.941666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:13.942247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:13.942703 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:14.012366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] MFA Rules not processed for user `ae8ae93c75144b65bdd29c16064c5aca`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:14.014762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:14.124858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1340/2649] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:14.138174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:14.140500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:14.186665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:14.234423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256635b-bfb5-494f-9987-5fc9b42841cf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:14.239270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:14.239900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:14.240222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:14.240615 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:14.253988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:14.256940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6b798-d512-431f-9801-b47dc0fbe5c4 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:14.270618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1310/2650] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:14.296032 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:14.302425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:14.382887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0860b7a-59c5-4a93-a182-600feb6c3d50 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:14.388734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:14.389389 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:14.389666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:14.389937 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] PATH_INFO: `/v3/users/ae8ae93c75144b65bdd29c16064c5aca` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:14.391162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8ae93c75144b65bdd29c16064c5aca)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:14.393136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:14.465524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8ae93c75144b65bdd29c16064c5aca'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:14.484316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8ae93c75144b65bdd29c16064c5aca'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:14.485080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8ae93c75144b65bdd29c16064c5aca'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:14.486029 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8ae93c75144b65bdd29c16064c5aca'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:14.495317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8ae93c75144b65bdd29c16064c5aca'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:14.517710 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1341/2651] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:14 2022] DELETE /identity/v3/users/ae8ae93c75144b65bdd29c16064c5aca => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:14.522592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:14.523266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:14.523266 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:14.547335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:14.548548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:14.657767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1311/2652] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:14.669493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:14.671370 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:14.752001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30acc6b-f53e-4445-b148-47545715449d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:14.756038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:14.756658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:14.756934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:14.757206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:14.771536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:14.773039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d053-1bd0-4d13-aa6c-ac6daf4e47fb service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:14.786421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1342/2653] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:15.122794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.124949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:15.138054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df28a-86b7-4b2f-8877-97511865c1ae None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.143322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.144363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.144639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.144907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] PATH_INFO: `/v3/projects/9aa75b6075b5451393af9849beb5c5a8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.146099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa75b6075b5451393af9849beb5c5a8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.148623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.209173 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa75b6075b5451393af9849beb5c5a8', 'request_id': 'req-594f937a-1596-4423-b9e1-008d0cf3dd0d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:15.221193 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa75b6075b5451393af9849beb5c5a8', 'request_id': 'req-594f937a-1596-4423-b9e1-008d0cf3dd0d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:15.231403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa75b6075b5451393af9849beb5c5a8', 'request_id': 'req-594f937a-1596-4423-b9e1-008d0cf3dd0d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:15.246658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] The token cache is being invalidate because project 9aa75b6075b5451393af9849beb5c5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:15.246658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:15.249915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-594f937a-1596-4423-b9e1-008d0cf3dd0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:15.251044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1312/2654] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:15 2022] DELETE /identity/v3/projects/9aa75b6075b5451393af9849beb5c5a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:15.256005 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.256360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.256638 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.277579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:15.279270 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:15.303892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:15.350835 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1343/2655] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:15.360141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.360420 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.360702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.385075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:15.386307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:15.394263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1313/2656] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:15.398685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.409445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62a997-8c2a-4a35-8f90-f068ca459a43 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.414415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.415044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.415843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.416114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.416801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:15.417104 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.418834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.433876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1344/2657] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:15.438431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.449511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b2def-28a3-422f-8c94-6aba2dbacd31 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.455008 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.455943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.455943 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.456262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.456876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.458897 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.494184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1314/2658] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:15 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:15.498667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.512250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25314-d8ca-439d-899b-0cf42f5720b2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.592776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.593415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.593688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.593955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.594765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.596550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.627140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1345/2659] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:15 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:15.631249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.646905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563ca49-d93b-4713-b7b8-6155cf043850 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.656051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.656770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.657115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.657462 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.658131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.659836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.672161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1315/2660] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:15.676178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.688669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcc0e6-2557-42ed-915e-c10a14f9d08b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.694144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.694799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.695080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.695356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.696003 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.697783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed1ea3-52dd-42b7-9d1e-82a45c6bc222 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.709501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1346/2661] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:15.715015 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.726414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba63e-ee6c-4a1b-b02c-b744bf32ad68 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:15.732127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:15.733106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.733427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.733729 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] PATH_INFO: `/v3/projects/a670c38182984aae9bc00789a2c8ea17/users/10a4b9b378b247828d16508eee78408c/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.739353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:15.754606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a670c38182984aae9bc00789a2c8ea17, user_id=10a4b9b378b247828d16508eee78408c, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:15.757586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:15.778300 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1316/2662] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:15 2022] PUT /identity/v3/projects/a670c38182984aae9bc00789a2c8ea17/users/10a4b9b378b247828d16508eee78408c/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:15.785097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:15.785379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:15.785595 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:15.818944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] MFA Rules not processed for user `10a4b9b378b247828d16508eee78408c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:15.819281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:15.919834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1347/2663] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:15.936005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:15.938531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:16.019641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54026ee-b570-42a4-a8fd-f6e0bdc01de0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:16.023472 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:16.024034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:16.024318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:16.024731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:16.037785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:16.039360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44087b06-c315-4609-8c10-715f56d04ec8 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:16.049143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1317/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:19.135955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:19.137581 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:19.170726 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:19.227836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aacc7-821c-4e1a-8bc8-18e3ff01e3df None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:19.232679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:19.233333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:19.233608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:19.233881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] PATH_INFO: `/v3/users/33e5e159fa3c4cd1a6d87d10db5d47fe` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:19.235375 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e5e159fa3c4cd1a6d87d10db5d47fe)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:19.237324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:19.295218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e5e159fa3c4cd1a6d87d10db5d47fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:19.309857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e5e159fa3c4cd1a6d87d10db5d47fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:19.310899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e5e159fa3c4cd1a6d87d10db5d47fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:19.311871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e5e159fa3c4cd1a6d87d10db5d47fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:19.331562 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e5e159fa3c4cd1a6d87d10db5d47fe'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:19.351712 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1348/2665] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:19 2022] DELETE /identity/v3/users/33e5e159fa3c4cd1a6d87d10db5d47fe => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:19.356303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:19.356853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:19.356853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:19.390896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:19.392144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:19.470722 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1318/2666] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:19.481501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:19.482953 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:19.551484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259fa16-51ba-485c-abd2-b8e3512440dc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:19.556265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:19.556917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:19.557210 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:19.557458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:19.567942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:19.569405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:19.580917 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1349/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:19.882470 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:19.884260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:19.904282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b403-517b-498b-b96b-4079e0745e18 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:19.912748 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:19.913408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:19.913684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:19.914099 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] PATH_INFO: `/v3/projects/90c9c82290ed47a9a4444e8b0ddd312b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:19.916131 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c9c82290ed47a9a4444e8b0ddd312b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:19.918104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:19.988145 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c9c82290ed47a9a4444e8b0ddd312b', 'request_id': 'req-32bed52f-187d-43ea-b8c4-0a16ab51f18f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.000294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c9c82290ed47a9a4444e8b0ddd312b', 'request_id': 'req-32bed52f-187d-43ea-b8c4-0a16ab51f18f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.006758 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c9c82290ed47a9a4444e8b0ddd312b', 'request_id': 'req-32bed52f-187d-43ea-b8c4-0a16ab51f18f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.018596 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] The token cache is being invalidate because project 90c9c82290ed47a9a4444e8b0ddd312b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:20.018988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.019647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.021158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1319/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:19 2022] DELETE /identity/v3/projects/90c9c82290ed47a9a4444e8b0ddd312b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:20.026720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:20.043885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235730-cb18-4bdb-a904-b6ccc1ce2a2e service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:20.101666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:20.121837 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:20.122461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:20.122765 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:20.123075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] PATH_INFO: `/v3/users/a4adac5fe32e4248970f5bdc0a3e66c7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:20.124164 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4adac5fe32e4248970f5bdc0a3e66c7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:20.126054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:20.181082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4adac5fe32e4248970f5bdc0a3e66c7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.188639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4adac5fe32e4248970f5bdc0a3e66c7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.189282 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4adac5fe32e4248970f5bdc0a3e66c7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.189929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4adac5fe32e4248970f5bdc0a3e66c7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.200386 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6bfa91fa-987b-4632-b580-c191f98b1b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4adac5fe32e4248970f5bdc0a3e66c7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.222689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1350/2669] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:20 2022] DELETE /identity/v3/users/a4adac5fe32e4248970f5bdc0a3e66c7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:20.546390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:20.548571 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:20.564895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed52f-187d-43ea-b8c4-0a16ab51f18f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:20.578143 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:20.650066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:20.651165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:20.651478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:20.651891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] PATH_INFO: `/v3/projects/a9fc0fba93804341ab57f16a85b80c3c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:20.653612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fc0fba93804341ab57f16a85b80c3c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:20.656727 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:20.724011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fc0fba93804341ab57f16a85b80c3c', 'request_id': 'req-be2bbc69-fd2b-446c-9453-f5688ea62105'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.732349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fc0fba93804341ab57f16a85b80c3c', 'request_id': 'req-be2bbc69-fd2b-446c-9453-f5688ea62105'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.738445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fc0fba93804341ab57f16a85b80c3c', 'request_id': 'req-be2bbc69-fd2b-446c-9453-f5688ea62105'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.750321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] The token cache is being invalidate because project a9fc0fba93804341ab57f16a85b80c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:20.750661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.751434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-be2bbc69-fd2b-446c-9453-f5688ea62105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:20.752921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1320/2670] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:20 2022] DELETE /identity/v3/projects/a9fc0fba93804341ab57f16a85b80c3c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:20.758044 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:20.759252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:20.759252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:20.779557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:20.781241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:20.866426 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1351/2671] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:20.878108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:20.878387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:20.878691 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.030264 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:21.031535 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:21.048427 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1321/2672] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:21.052876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.063553 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9312f-2912-4aaa-ab6b-a6be743efb5f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.068175 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.068798 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.069087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.069348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.070049 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:21.070348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.072755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.086598 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1352/2673] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:21.091262 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.101169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656cce0-61c3-41e2-9f3c-f2cd0ff2dec5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.106302 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.106976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.107314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.108336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.109496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.113917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.151863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1322/2674] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:21.156998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.169969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db2ad-d82e-4ad1-8251-2ca9a79eefb8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.227250 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:21.240359 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.240857 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.241132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.241355 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.241997 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.245097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.269473 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1353/2675] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:21.275754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.286883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8d48-3f61-4c49-ac8d-37e9c0c53043 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.292227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.292834 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.293107 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.293376 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.294005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.295617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.310543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1323/2676] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:21.314561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.325041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524cc1-4a0b-4054-8ad2-973414a3f690 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.329836 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.330442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.330747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.331016 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.331657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.333255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac540768-3144-4401-a537-308da7b06300 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.345294 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1354/2677] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:21.349830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.361024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6130b-c2ea-400d-8a4d-3bced1dce5fe admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.367585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.369286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.369742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.370369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] PATH_INFO: `/v3/projects/8b67947b8d20475db8532e401ce8e2ea/users/00149d3339034f0e97f745cc89be6a29/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.388197 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b67947b8d20475db8532e401ce8e2ea, user_id=00149d3339034f0e97f745cc89be6a29, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.390879 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.406239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1324/2678] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:21 2022] PUT /identity/v3/projects/8b67947b8d20475db8532e401ce8e2ea/users/00149d3339034f0e97f745cc89be6a29/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:21.417830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.418119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.418382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.455502 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] MFA Rules not processed for user `00149d3339034f0e97f745cc89be6a29`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:21.457319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:21.527887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1355/2679] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:21.532760 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.582063 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:21.606689 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b39-b37f-4f4e-962e-cbccff80a7ff admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.611912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81de069-6687-48af-b89d-164651928315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.612541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de069-6687-48af-b89d-164651928315 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.612812 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de069-6687-48af-b89d-164651928315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.613084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de069-6687-48af-b89d-164651928315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.613739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81de069-6687-48af-b89d-164651928315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.615863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81de069-6687-48af-b89d-164651928315 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.646336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1325/2680] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:21.650950 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.661966 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190288ba-f54d-4aac-8da1-0bad9aff4ef8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.706877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81de069-6687-48af-b89d-164651928315 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.708630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c81de069-6687-48af-b89d-164651928315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:21.740474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.741099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.741493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.742243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.743200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.745492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.771817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1356/2681] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:21.778119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.789643 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9235f3-ac2a-4f79-90cc-cc88b3db8e55 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.791867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81de069-6687-48af-b89d-164651928315 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.795256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.795860 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.796133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.796654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.796770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.797067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.797440 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.797660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.797885 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] PATH_INFO: `/v3/users/10a4b9b378b247828d16508eee78408c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.798694 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.799075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a4b9b378b247828d16508eee78408c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.800992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.810280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1357/2682] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:21.815403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.826211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4ac1-2b5d-4a6c-9d4c-5772234fe6ad admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.833096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:21.833843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.834241 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.834550 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] PATH_INFO: `/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.858079 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7d5d21bdbb49b780b71f086a15dc6b, user_id=0f1ac04fbf1a4f8fbeb5aad8bf28ae76, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:21.860847 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:21.861296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a4b9b378b247828d16508eee78408c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:21.871120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a4b9b378b247828d16508eee78408c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:21.871120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a4b9b378b247828d16508eee78408c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:21.874796 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a4b9b378b247828d16508eee78408c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:21.880038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1358/2683] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:21 2022] PUT /identity/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:21.884450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:21.884663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-275e628c-33ad-4439-b322-497366614a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a4b9b378b247828d16508eee78408c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:21.885974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:21.900942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:21.906537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1326/2684] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:21 2022] DELETE /identity/v3/users/10a4b9b378b247828d16508eee78408c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:21.911814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:21.912182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:21.912374 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:21.934864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:21.936026 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:21.972167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a12a-1192-45f4-aef2-7395c4615eaa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:21.987453 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:22.016767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1327/2685] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:22.027281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.028719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.046446 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.047974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.048308 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.048650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.049372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.051139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.065766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1359/2686] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:22.069274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.084002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef810-d210-4044-8c06-e490d50e03a2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.090448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.091157 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.091484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.091691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] PATH_INFO: `/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.093648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7d5d21bdbb49b780b71f086a15dc6b, user_id=0f1ac04fbf1a4f8fbeb5aad8bf28ae76, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.097410 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a90927-506a-4636-88b1-d4fa027a6a72 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.118067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1360/2687] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:22 2022] PUT /identity/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:22.122230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.122761 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.123428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.133044 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba900c-3b5c-4f1d-9f7a-3d73534d28dd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.161167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] MFA Rules not processed for user `0f1ac04fbf1a4f8fbeb5aad8bf28ae76`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:22.163163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.194022 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.194734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.195051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.195360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.244878 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1361/2688] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:22.258256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.260974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.267169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.269582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.286678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1328/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:21:22.315434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:22.364068 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944dff-3460-464c-82d8-0658e9ebf2b6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.368942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.369570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.369851 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.370124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.382379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.385778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.396931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1362/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:22.502246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.514606 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f348a0-2079-4bde-a6a7-040d87eff9b9 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.520426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.521120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.521415 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.521673 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.523990 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.592594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:22.612114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.613560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69103-454a-4dde-a96f-8e478d52dd46 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.624991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1329/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:22.640025 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.642291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.658651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508eb70-e80b-46a1-8830-5a98ef20b218 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.664657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.665839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.666116 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.666381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] PATH_INFO: `/v3/projects/a670c38182984aae9bc00789a2c8ea17` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.667570 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a670c38182984aae9bc00789a2c8ea17)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.669948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:22.744345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a670c38182984aae9bc00789a2c8ea17', 'request_id': 'req-1c30192b-a8a0-4893-8106-fda71f8470bd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:22.754074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a670c38182984aae9bc00789a2c8ea17', 'request_id': 'req-1c30192b-a8a0-4893-8106-fda71f8470bd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:22.761432 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a670c38182984aae9bc00789a2c8ea17', 'request_id': 'req-1c30192b-a8a0-4893-8106-fda71f8470bd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:22.776809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] The token cache is being invalidate because project a670c38182984aae9bc00789a2c8ea17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:22.777171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:22.778101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c30192b-a8a0-4893-8106-fda71f8470bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:22.779750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1363/2692] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:22 2022] DELETE /identity/v3/projects/a670c38182984aae9bc00789a2c8ea17 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:22.784643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.785007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.785286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.812261 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:22.813721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.884632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1330/2693] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:22.893433 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.893718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.894122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.920200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:22.921819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:22.932842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1364/2694] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:22.937706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:22.953684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b90d1-aad2-43d0-8c78-d2b04f694c2a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:22.959549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:22.960520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:22.960865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:22.961031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:22.961704 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:22.962009 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:22.963961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.002312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1331/2695] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:23.003213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.018074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89fe3-7a58-4a5e-bece-3b44f7efbcb6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.030909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.031972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.032425 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.033081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.034346 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.038402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.090177 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.090738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1365/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:23 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:23.104209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d433-7dd6-4835-828f-e9b930a39213 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.172917 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.173757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.173884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.174098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.174874 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.176836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.205379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1332/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:23 2022] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:23.213008 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.223542 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5bce-ab8c-4338-b0b7-aabca3cc84c5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.229760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.230357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.230671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.230941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.231627 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.233256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.246106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1366/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:23.250407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.271975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b2db5-bcac-457d-8d22-e71a1dc2d119 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.277902 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.278577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.278880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.279152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.279797 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.281401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859844a5-9a35-4728-a4fb-c764bf467d07 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.293999 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1333/2699] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:23.299395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.309813 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51af835-0164-4f60-8d14-13fa1e6a1346 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.315667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.316493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.316819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.317145 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] PATH_INFO: `/v3/projects/c4705abbf1034dfca3c6cd2e92d85ff2/users/71794f244d0743eea749a286f61b5455/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.343594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4705abbf1034dfca3c6cd2e92d85ff2, user_id=71794f244d0743eea749a286f61b5455, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.348940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.367858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1367/2700] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:23 2022] PUT /identity/v3/projects/c4705abbf1034dfca3c6cd2e92d85ff2/users/71794f244d0743eea749a286f61b5455/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:23.379355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368814-e171-4726-bbd5-2512b31adfca None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.379655 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368814-e171-4726-bbd5-2512b31adfca None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.379957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368814-e171-4726-bbd5-2512b31adfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.419881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-53368814-e171-4726-bbd5-2512b31adfca None None] MFA Rules not processed for user `71794f244d0743eea749a286f61b5455`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:23.421579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-53368814-e171-4726-bbd5-2512b31adfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:23.470948 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:23.498158 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1334/2701] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:23.534353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.536880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:23.602015 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6859b2-e5f7-4e96-89da-88542b136886 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.605612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.606238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.606533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.606808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.612256 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:23.616381 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.618271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e118ae-9ecb-45e4-883d-cf5edf9998cf service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.631283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1368/2702] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:23.651467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368814-e171-4726-bbd5-2512b31adfca None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.734623 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368814-e171-4726-bbd5-2512b31adfca None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:23.741176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:23.742109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.742386 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.742695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] PATH_INFO: `/v3/users/71794f244d0743eea749a286f61b5455` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.743970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71794f244d0743eea749a286f61b5455)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:23.745871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:23.809489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71794f244d0743eea749a286f61b5455'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:23.818947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71794f244d0743eea749a286f61b5455'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:23.819589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71794f244d0743eea749a286f61b5455'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:23.820221 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71794f244d0743eea749a286f61b5455'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:23.828671 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71794f244d0743eea749a286f61b5455'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:23.851235 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1335/2703] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:23 2022] DELETE /identity/v3/users/71794f244d0743eea749a286f61b5455 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:23.856009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:23.856226 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:23.856506 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:23.877573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:23.879507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:23.952182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1369/2704] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:21:23.962258 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:23.963734 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:24.030716 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51f730-1dc9-42a0-9b9c-9e02942a2d4e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:24.035054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:24.035658 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:24.036274 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:24.036532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:24.046795 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:24.048284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:24.060332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1336/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:24.419277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:24.421561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:24.436665 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0489fb-0484-4a1f-ad51-783c6b1f4ca1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:24.442755 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:24.443538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:24.444169 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:24.444679 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] PATH_INFO: `/v3/projects/c4705abbf1034dfca3c6cd2e92d85ff2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:24.445862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4705abbf1034dfca3c6cd2e92d85ff2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:24.447855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:24.503400 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4705abbf1034dfca3c6cd2e92d85ff2', 'request_id': 'req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:24.513238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4705abbf1034dfca3c6cd2e92d85ff2', 'request_id': 'req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:24.519556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4705abbf1034dfca3c6cd2e92d85ff2', 'request_id': 'req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:24.534448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] The token cache is being invalidate because project c4705abbf1034dfca3c6cd2e92d85ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:24.534763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:24.535430 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:24.537215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1370/2706] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:24 2022] DELETE /identity/v3/projects/c4705abbf1034dfca3c6cd2e92d85ff2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:27.761810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:27.767871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:27.772188 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7ed9-5c61-4447-8594-11a26bbefc0b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:27.778713 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:27.780124 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:27.831161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:27.831762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:27.832033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:27.832299 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:27.834048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:27.846609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:27.848214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd5d8-7d27-4036-881a-59f02d42c1ed service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:27.849662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecd8b4-0825-4679-9c55-210dcd57cbe3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:27.854915 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:27.855539 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:27.855811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:27.856078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] PATH_INFO: `/v3/users/00149d3339034f0e97f745cc89be6a29` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:27.857247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=00149d3339034f0e97f745cc89be6a29)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:27.858259 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1337/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:21:27.859197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:27.883802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:27.915479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00149d3339034f0e97f745cc89be6a29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:27.923887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00149d3339034f0e97f745cc89be6a29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:27.924669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00149d3339034f0e97f745cc89be6a29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:27.925382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00149d3339034f0e97f745cc89be6a29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:27.933111 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00149d3339034f0e97f745cc89be6a29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:27.952717 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1371/2708] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:27 2022] DELETE /identity/v3/users/00149d3339034f0e97f745cc89be6a29 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:27.957226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:27.957511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:27.957785 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:27.979423 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:27.980647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:28.043705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1338/2709] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:28.054535 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:28.055876 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:28.114418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d2e4-9056-48a8-afc6-b5f62dc436ee admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:28.118133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:28.118779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:28.119047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:28.119314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:28.128469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:28.129891 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:28.139956 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1372/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:28.461753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:28.463916 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:28.476224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4160-627f-4853-ae54-927ac1845e2e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:28.486276 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:28.487110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:28.488549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:28.489249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] PATH_INFO: `/v3/projects/8b67947b8d20475db8532e401ce8e2ea` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:28.490920 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b67947b8d20475db8532e401ce8e2ea)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:28.493554 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:28.554307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b67947b8d20475db8532e401ce8e2ea', 'request_id': 'req-7151da4e-7867-4e36-bde8-0f9c4f775529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.563108 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b67947b8d20475db8532e401ce8e2ea', 'request_id': 'req-7151da4e-7867-4e36-bde8-0f9c4f775529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.569065 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b67947b8d20475db8532e401ce8e2ea', 'request_id': 'req-7151da4e-7867-4e36-bde8-0f9c4f775529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.581669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] The token cache is being invalidate because project 8b67947b8d20475db8532e401ce8e2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:28.581954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.582648 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.584150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1339/2711] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:28 2022] DELETE /identity/v3/projects/8b67947b8d20475db8532e401ce8e2ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:28.588316 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:28.598395 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e4b98-436a-408a-a31e-02b32b986fcb service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:28.664431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:28.665756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:28.666033 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:28.666304 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] PATH_INFO: `/v3/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:28.667672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1ac04fbf1a4f8fbeb5aad8bf28ae76)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:28.669411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:28.717639 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:28.724725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1ac04fbf1a4f8fbeb5aad8bf28ae76'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.735457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1ac04fbf1a4f8fbeb5aad8bf28ae76'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.736076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1ac04fbf1a4f8fbeb5aad8bf28ae76'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.736718 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1ac04fbf1a4f8fbeb5aad8bf28ae76'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.745139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-245be5db-14e0-4361-a485-608fd034c8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1ac04fbf1a4f8fbeb5aad8bf28ae76'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:28.770504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1373/2712] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:28 2022] DELETE /identity/v3/users/0f1ac04fbf1a4f8fbeb5aad8bf28ae76 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:29.106090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.108021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:29.124904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151da4e-7867-4e36-bde8-0f9c4f775529 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.156700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:29.192741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.193278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.193551 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.193823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] PATH_INFO: `/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.194974 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7d5d21bdbb49b780b71f086a15dc6b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.196919 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.251581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7d5d21bdbb49b780b71f086a15dc6b', 'request_id': 'req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:29.261508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7d5d21bdbb49b780b71f086a15dc6b', 'request_id': 'req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:29.267807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7d5d21bdbb49b780b71f086a15dc6b', 'request_id': 'req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:29.280379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] The token cache is being invalidate because project 7c7d5d21bdbb49b780b71f086a15dc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:29.280667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:29.281338 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ef834ed8-56f8-4057-ba99-ae1a6e05e8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:29.282899 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1340/2713] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:29 2022] DELETE /identity/v3/projects/7c7d5d21bdbb49b780b71f086a15dc6b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:29.290199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.290758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.290758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.310534 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:29.311731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:29.378342 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1374/2714] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:29.390347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.390752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.391152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.413585 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:29.415468 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:29.423865 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1341/2715] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:29.428293 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.440514 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79463ed-8e69-4fea-b09f-4672730f8e99 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.454849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.455479 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.457414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.457414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.458644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:29.458965 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.461488 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.476791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1375/2716] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:29.481278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.503703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2312e0-a32e-4c03-9c70-1c8d20b08e52 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.516933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.517794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.518329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.518873 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.519592 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.523707 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.566522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1342/2717] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:29 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:29.568930 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.580597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b185-cd17-4c17-aeaf-9b217c978b80 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.643283 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.643900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.644216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.644476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.645327 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.647070 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.671780 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1376/2718] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:29 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:21:29.676071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.687284 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebb96-0d37-4981-a48f-0d93d8dadbd7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.692635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.693987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.694291 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.694597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.695246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.698548 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.717528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1343/2719] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:29.722360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.737345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31345a74-42e9-4a4a-b2f8-93c6d9ae9872 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.744081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.744739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.745041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.745309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.745903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.747926 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b149e0e-de50-43d1-a691-8409e09acf6e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.772552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1377/2720] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:29.775156 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:29.792267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e0d5-a5b9-40ca-a158-f46f7af62dc2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:29.798067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:29.798918 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.799295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.799780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] PATH_INFO: `/v3/projects/a711831899df40dd9cf2f0c343cb2e57/users/71ce512c259440ddbb2ff227203b29df/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.816896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a711831899df40dd9cf2f0c343cb2e57, user_id=71ce512c259440ddbb2ff227203b29df, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:29.819632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:29.847414 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1344/2721] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:29 2022] PUT /identity/v3/projects/a711831899df40dd9cf2f0c343cb2e57/users/71ce512c259440ddbb2ff227203b29df/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:21:29.849263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:29.849549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:29.849817 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:29.887347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] MFA Rules not processed for user `71ce512c259440ddbb2ff227203b29df`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:29.888617 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:29.908739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:29.988161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1378/2722] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:29.999296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:30.001037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:30.068192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bed8-4631-4373-93ca-fd3d3faa0fcc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:30.072700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:30.073315 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:30.073587 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:30.073954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:30.083325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:30.084767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:30.089684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:30.094881 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1345/2723] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:38.094384 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:38.095896 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:38.182653 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fa875-62f6-4c39-9d40-1ab058a4d161 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:38.186228 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:38.186858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:38.187133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:38.187403 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:38.189216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:38.272663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:38.274134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fe32-c1f4-4ade-a4db-49c59e7f8e10 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:38.283872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1379/2724] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:40.678612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:40.790117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fc3c6-fcbd-45f5-90cd-06a6d96db156 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:40.794833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:40.795459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:40.795736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:40.796005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] PATH_INFO: `/v3/users/71ce512c259440ddbb2ff227203b29df` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:40.797132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ce512c259440ddbb2ff227203b29df)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:40.799086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:40.864296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ce512c259440ddbb2ff227203b29df'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:40.875574 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ce512c259440ddbb2ff227203b29df'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:40.876222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ce512c259440ddbb2ff227203b29df'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:40.876986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ce512c259440ddbb2ff227203b29df'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:40.887695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ce512c259440ddbb2ff227203b29df'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:40.911492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1346/2725] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:21:40 2022] DELETE /identity/v3/users/71ce512c259440ddbb2ff227203b29df => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:40.916421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:40.917067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:40.917067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:40.943125 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:40.967252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:40.968731 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:41.036657 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1380/2726] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:41.047352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.048657 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:41.111045 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:41.124678 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3d9d6-4286-4ec8-a83e-2f48507a6558 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.128486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.129083 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.129355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.129618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.138457 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.139912 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387e280-d4f7-4334-a3e8-2c0937e2731d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.149973 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1347/2727] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:41.475390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.477043 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:41.489882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1707-b401-4c17-8f8b-ac91cc8b9848 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.494854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.495496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.495768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.496048 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] PATH_INFO: `/v3/projects/a711831899df40dd9cf2f0c343cb2e57` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.497357 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a711831899df40dd9cf2f0c343cb2e57)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.499307 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.550793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a711831899df40dd9cf2f0c343cb2e57', 'request_id': 'req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:41.561066 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a711831899df40dd9cf2f0c343cb2e57', 'request_id': 'req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:41.568882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a711831899df40dd9cf2f0c343cb2e57', 'request_id': 'req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:41.585673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] The token cache is being invalidate because project a711831899df40dd9cf2f0c343cb2e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:21:41.586680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:41.587358 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8e768c2f-8f7c-4cf1-9e6e-20e1a36bf82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:21:41.588869 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1381/2728] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:21:41 2022] DELETE /identity/v3/projects/a711831899df40dd9cf2f0c343cb2e57 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:41.595699 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.595984 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.596253 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.650246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:41.651549 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:41.720526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1348/2729] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:41.728118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.728528 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.728911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.748954 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:41.750139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:41.758642 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1382/2730] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:41.762586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.772166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14148c-cd55-4f19-8bfd-addb318b8980 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.777703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.778311 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.778618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.778890 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.779561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:21:41.779864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.781515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.793726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1349/2731] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:21:41.797983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.807858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b470a0-7a50-441f-a660-1d7efa45d54c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.812437 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.813018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.813287 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.813582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.814199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.816100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.846955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1383/2732] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:21:41 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:41.851257 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.861787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b509-eaa1-453c-ae66-1d003129a001 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.918583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.919091 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.919366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.919633 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.920249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.922152 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.943903 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1350/2733] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:21:41 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:21:41.948842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.959146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d400-27a0-4b23-8397-e62c7ec5055b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.963748 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.964328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.964599 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.964862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.965484 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:41.967117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:41.977619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1384/2734] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:21:41.981543 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:41.991496 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7be83-cceb-4c63-bea5-7c538696755f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:41.996646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:41.997226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:41.997505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:41.997778 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:41.998404 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:42.000007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c86a67-650c-468b-bd74-7f0c4a73a963 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:42.010991 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1351/2735] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:21:42.015106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:42.025238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe2cc-82ab-4923-b1c4-8438beac44c3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:42.029738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:42.030372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:42.030676 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:42.030949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] PATH_INFO: `/v3/projects/d46f4f9502e94cc9a246dcbd80dee228/users/61a8ca6d8d86478a8ee718266b3d85df/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:42.045819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46f4f9502e94cc9a246dcbd80dee228, user_id=61a8ca6d8d86478a8ee718266b3d85df, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:42.048464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:42.061778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1385/2736] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:21:42 2022] PUT /identity/v3/projects/d46f4f9502e94cc9a246dcbd80dee228/users/61a8ca6d8d86478a8ee718266b3d85df/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:21:42.073067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a140-5912-4c13-b060-527749da9cf5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:42.073348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a140-5912-4c13-b060-527749da9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:42.073620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07a140-5912-4c13-b060-527749da9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:42.102880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0d07a140-5912-4c13-b060-527749da9cf5 None None] MFA Rules not processed for user `61a8ca6d8d86478a8ee718266b3d85df`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:42.104076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d07a140-5912-4c13-b060-527749da9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:42.121126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:42.171923 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1352/2737] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:42.185360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:42.187063 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:42.210680 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:42.263347 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359991-fabd-409f-9234-170b65d01c18 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:42.267093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:42.267688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:42.267976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:42.268246 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:42.277459 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:42.278934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:42.288102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1386/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:43.731106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:43.731680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:43.731680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:43.751971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] MFA Rules not processed for user `61a8ca6d8d86478a8ee718266b3d85df`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:43.753184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:43.760421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1353/2739] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:44.798159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:44.799580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:44.899579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e855-b159-42b0-a496-68d0d82bdcc8 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:44.904773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:44.905391 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:44.905699 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:44.906036 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:44.908012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:44.919753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:44.921314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35e4de-cdca-479c-afea-7198377ac81a service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:44.931920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1387/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:53.747255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=22 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:54.927064 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=59 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:21:59.040825 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:59.042332 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:59.137575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f64cb-a920-45ee-9386-0a5c36913560 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:59.141584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:59.142269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:59.142577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:59.142850 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:59.144583 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:59.146697 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801c0e-cd73-4e79-9a8a-f0ad7d479973 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:59.147179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801c0e-cd73-4e79-9a8a-f0ad7d479973 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:59.147404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801c0e-cd73-4e79-9a8a-f0ad7d479973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:59.178424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-81801c0e-cd73-4e79-9a8a-f0ad7d479973 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:59.180230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-81801c0e-cd73-4e79-9a8a-f0ad7d479973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:59.216100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:59.217520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:59.228632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1354/2741] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:21:59.262361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1388/2742] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:59.283968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:59.285728 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:59.365537 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6a6d-e355-4e4f-9387-0e38a65fab6c service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:59.371744 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:21:59.372363 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:59.372639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:59.372909 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:59.381527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:21:59.383142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:21:59.391595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1355/2743] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:21:59.939440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b4b8-e498-4123-bbe1-d872fb1ab170 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:21:59.939916 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b4b8-e498-4123-bbe1-d872fb1ab170 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:21:59.940259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b4b8-e498-4123-bbe1-d872fb1ab170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:21:59.960868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e4e8b4b8-e498-4123-bbe1-d872fb1ab170 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:21:59.962096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e4e8b4b8-e498-4123-bbe1-d872fb1ab170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:21:59.969693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1389/2744] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:21:59.983566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:21:59.994456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9fde-a4dd-4c83-a481-f520135f5206 service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:21:59.999883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:00.000487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:00.000761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:00.001025 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:00.010227 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:00.011818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:00.020163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1356/2745] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:22:00.299546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfa300-5d37-4027-8479-63d734ca8046 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:00.305842 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfa300-5d37-4027-8479-63d734ca8046 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:00.306345 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfa300-5d37-4027-8479-63d734ca8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:00.329552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-79dfa300-5d37-4027-8479-63d734ca8046 None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:00.331161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-79dfa300-5d37-4027-8479-63d734ca8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:00.340274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1390/2746] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Sep 19 16:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:00.355225 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:00.369579 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13f84a-41f1-4b3e-871a-25187e33e86d service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:00.375321 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:00.376133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:00.376481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:00.376481 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:00.383228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:00.387367 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:00.389297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:00.399800 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1357/2747] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:22:00.780081 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:00.780417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:00.780621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:00.802559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] MFA Rules not processed for user `bcdb2a128abf4469b6ac5a7ac9459615`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:00.804252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:00.824344 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1391/2748] 10.222.0.27 () {58 vars in 967 bytes} [Mon Sep 19 16:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:00.849360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:00.861931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57bcd-8353-474d-8f2a-65a716318a9f service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:00.868068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bce1766c4c4ed09127855dd79ec9bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:00.869033 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:00.869487 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:00.870068 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:00.883977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:00.887109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:00.901866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1358/2749] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Sep 19 16:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:22:02.724409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:02.726649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:02.741796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b27b0-f398-4ab9-909d-082e1598eacd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:02.746280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:02.746959 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:02.747236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:02.747500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] PATH_INFO: `/v3/users/6c49fa2c8e9347478e7e434efd0fb80f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:02.748616 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c49fa2c8e9347478e7e434efd0fb80f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:02.750580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:02.797826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c49fa2c8e9347478e7e434efd0fb80f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:02.806882 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c49fa2c8e9347478e7e434efd0fb80f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:02.807648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c49fa2c8e9347478e7e434efd0fb80f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:02.808265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c49fa2c8e9347478e7e434efd0fb80f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:02.817888 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c49fa2c8e9347478e7e434efd0fb80f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:02.850967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1392/2750] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:02 2022] DELETE /identity/v3/users/6c49fa2c8e9347478e7e434efd0fb80f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:03.040705 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.053308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c38b-61e0-436d-b405-a2f414a7ca2e service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.115355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.116566 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.116846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.117182 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] PATH_INFO: `/v3/projects/26e69f01233d4df6844b937e771c9b52` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.118303 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e69f01233d4df6844b937e771c9b52)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.120222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.148324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.150093 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.168317 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd40c-41d9-4509-a5ad-9b43e55bb0ae admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.172268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e69f01233d4df6844b937e771c9b52', 'request_id': 'req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.181534 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e69f01233d4df6844b937e771c9b52', 'request_id': 'req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.187853 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e69f01233d4df6844b937e771c9b52', 'request_id': 'req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.200146 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] The token cache is being invalidate because project 26e69f01233d4df6844b937e771c9b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:03.200557 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.202600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b3e3bd9-f53d-4681-9f5d-ae2bbf1a536a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.205180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1359/2751] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:03 2022] DELETE /identity/v3/projects/26e69f01233d4df6844b937e771c9b52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:03.212329 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19f48-41ce-4bef-9f26-6c1103e760b0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.212810 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19f48-41ce-4bef-9f26-6c1103e760b0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.213155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19f48-41ce-4bef-9f26-6c1103e760b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.213592 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:03.234007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.234762 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.234938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.235212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] PATH_INFO: `/v3/users/61a8ca6d8d86478a8ee718266b3d85df` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.236387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a8ca6d8d86478a8ee718266b3d85df)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.236555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4fc19f48-41ce-4bef-9f26-6c1103e760b0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:03.237626 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4fc19f48-41ce-4bef-9f26-6c1103e760b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.238339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.246498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1360/2752] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:03.255490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.255779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.256042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.277285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:03.278511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.288966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1361/2753] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:03.293893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.300153 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a8ca6d8d86478a8ee718266b3d85df'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.303786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8aa88-28e9-4b2d-890e-25c22554b3b0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.309319 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a8ca6d8d86478a8ee718266b3d85df'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.310001 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a8ca6d8d86478a8ee718266b3d85df'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.310385 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.310689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a8ca6d8d86478a8ee718266b3d85df'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.311384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.312459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.312459 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.314572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:22:03.314572 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.315979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.318814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-53ec40a9-07f5-4f20-8393-f3e1176b7f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a8ca6d8d86478a8ee718266b3d85df'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.335520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1362/2754] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:22:03.339887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.340960 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1393/2755] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:03 2022] DELETE /identity/v3/users/61a8ca6d8d86478a8ee718266b3d85df => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:03.341520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.345360 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.345644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.345913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.356934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30eb3-ee56-453b-bd47-2f44af26a924 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.371109 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:03.372397 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.401087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:03.421742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.422419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.422731 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.423021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.423979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.425877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.440263 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1394/2756] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:03.451544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.452976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.457642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1363/2757] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:22:03.458808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.516561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02a9c-85d0-42dc-a50b-d77560f188eb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.529747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:03.533854 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571cc4-624c-4346-8c14-1dd508c22ce4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.539672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.540283 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.540555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.540833 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.541488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.543460 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.570669 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1364/2758] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:22:03.571841 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.575467 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.576076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.576351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.576622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.582052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740119c-37a3-4fde-ac6f-8afecf76e38d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.587202 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.587799 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.588071 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.588337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.588967 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.589146 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.590577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.591452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.602074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1365/2759] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:03.605818 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1395/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:22:03.606875 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.617336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d2cd-e282-47a8-80e9-000e258b07b5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.622043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.622801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.623030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.623248 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.623970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.625546 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233ad5e-02b9-4306-8c03-c46b71f1a0b4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.637003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1366/2761] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:22:03.641173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.652931 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066f6e-e17b-47cc-80d5-2ee4232dc9d4 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.658148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.658874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.659137 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.659415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] PATH_INFO: `/v3/projects/1779038a744d4647a3ecaaa4cf4d6ce8/users/e77a086c330c42cf9ea172cab113283c/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.678421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779038a744d4647a3ecaaa4cf4d6ce8, user_id=e77a086c330c42cf9ea172cab113283c, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.681196 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.695864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1396/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:03 2022] PUT /identity/v3/projects/1779038a744d4647a3ecaaa4cf4d6ce8/users/e77a086c330c42cf9ea172cab113283c/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:03.700826 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.701137 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.701409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.722708 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:03.724506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.792751 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1367/2763] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:03.805899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.806361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.808176 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:03.809563 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.826120 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe377b48-1da6-4137-b5f0-140e7e26a742 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.831501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.832206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.832478 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.832754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] PATH_INFO: `/v3/projects/d46f4f9502e94cc9a246dcbd80dee228` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.833970 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46f4f9502e94cc9a246dcbd80dee228)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:03.836456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:03.876660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:03.879486 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bb6c6-c510-4a59-979c-009fa77feb08 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:03.895418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46f4f9502e94cc9a246dcbd80dee228', 'request_id': 'req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.905921 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46f4f9502e94cc9a246dcbd80dee228', 'request_id': 'req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.913953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46f4f9502e94cc9a246dcbd80dee228', 'request_id': 'req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.929166 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] The token cache is being invalidate because project d46f4f9502e94cc9a246dcbd80dee228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:03.929443 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.930794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f2b25d01-3ba3-4b5d-ba2d-fbbacb25f3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:03.936417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1368/2764] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:03 2022] DELETE /identity/v3/projects/d46f4f9502e94cc9a246dcbd80dee228 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:03.941353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.941632 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.941962 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.943900 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:03.945030 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:03.945305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:03.945575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:03.947387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:03.963755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:03.964953 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.017492 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.018976 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e95b8-ba84-4aba-bde8-c8a7be13d9b4 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.029119 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1397/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:04.032986 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1369/2766] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:04.042999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.043449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.043885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.052795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:04.067814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:04.069082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.078180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1398/2767] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:04.083164 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.093584 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee52fd-d4cb-43e3-9176-686029a31d27 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.098947 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.099827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.100279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.100781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.101987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:22:04.102424 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.104205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.119322 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1370/2768] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:22:04.124531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.135516 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94addf-b9f4-41d4-b5b4-a17d33c12be9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.141350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.142097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.142392 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.142682 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.143436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.145428 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.177751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1399/2769] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:04.183056 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.195273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f82c7-c498-475f-8cb8-fff7fad041fe admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.267310 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.267989 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.268201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.268469 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.269200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.271489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.309641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1371/2770] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:04.321756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.336691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed85e5d-6729-4978-bde4-f0640ae3e6ac admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.341541 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.342148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.342418 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.342789 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.343334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.344934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.356962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1400/2771] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:04.362012 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.374867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231ef08-9f00-48b7-9e19-2a678a1145d6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.380924 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.381700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.382229 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.382526 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.383401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.385894 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc91e9-c25b-4f12-a0b0-d3a77930cb2c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.402713 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1372/2772] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:04.404521 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.422777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d069-2b54-4859-b55f-b71fa4953512 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.427833 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.429083 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.429366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.430331 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] PATH_INFO: `/v3/projects/67bb7aac3b5c4755b29ce88b3af1e3e3/users/777bed5cc15243449cca839b29d13db5/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.446911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bb7aac3b5c4755b29ce88b3af1e3e3, user_id=777bed5cc15243449cca839b29d13db5, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.449568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.465773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1401/2773] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:04 2022] PUT /identity/v3/projects/67bb7aac3b5c4755b29ce88b3af1e3e3/users/777bed5cc15243449cca839b29d13db5/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:04.471323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e363-5b6a-462d-ad95-629cd3c254ea None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.471635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e363-5b6a-462d-ad95-629cd3c254ea None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.471911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e363-5b6a-462d-ad95-629cd3c254ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.497035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7bd2e363-5b6a-462d-ad95-629cd3c254ea None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:04.497035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7bd2e363-5b6a-462d-ad95-629cd3c254ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.518849 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:04.566931 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1373/2774] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:04.578788 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.581078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.645195 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad80da4-c534-4425-ab5e-5be42b4fbb70 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.649578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.650868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.651139 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.651448 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.663948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.665417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.675951 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1402/2775] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:04.741759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.742067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.742342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.774577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] MFA Rules not processed for user `e77a086c330c42cf9ea172cab113283c`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:04.775872 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.864191 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1374/2776] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:04.869100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.870756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:04.887092 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd982-eb08-4dcc-b5b1-3e8e605fb38b service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:04.892884 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:04.893721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:04.893889 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:04.894229 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:04.894918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:04.897183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:04.932935 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1403/2777] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:04.936155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:04.956035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7df39c-462a-493a-82f9-8c778a35d1fb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.030864 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.031527 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.031801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.032069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.032700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.034742 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.062238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1375/2778] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:04 2022] POST /identity/v3/users => generated 307 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:05.066546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:05.081267 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9de68-d414-451b-802b-152fda24f25e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.087041 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.087841 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.088215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.088611 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.089373 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.091087 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.106783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1404/2779] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:05.108542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:05.120124 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0d9cb-1130-40db-83ee-79bfa0f18160 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.125228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.125893 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.126148 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.126447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] PATH_INFO: `/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00/users/c84518a65e764ec28036fd39d316ce3d/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.143681 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e92a434d3a484bb5f2fd062ff07c00, user_id=c84518a65e764ec28036fd39d316ce3d, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.146393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.163263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1376/2780] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:05 2022] PUT /identity/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00/users/c84518a65e764ec28036fd39d316ce3d/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:05.167667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:05.178972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650a29-2256-4adf-8737-f61567d2a88f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.238637 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.239248 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.239520 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.239863 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.240500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.242235 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1b9a3-68aa-448b-b468-203cac6a30e3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.255416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1405/2781] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:22:05.257228 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:05.268088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92d88c-9ed9-4b4e-802d-fe41079635e2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.274768 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.276726 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.279105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.279105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] PATH_INFO: `/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00/users/c84518a65e764ec28036fd39d316ce3d/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.282313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e92a434d3a484bb5f2fd062ff07c00, user_id=c84518a65e764ec28036fd39d316ce3d, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.285016 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.296883 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1377/2782] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:05 2022] PUT /identity/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00/users/c84518a65e764ec28036fd39d316ce3d/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:05.413435 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0948-9ce6-45d2-9b42-c1e2c3865045 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.413828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0948-9ce6-45d2-9b42-c1e2c3865045 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.414374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0948-9ce6-45d2-9b42-c1e2c3865045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.425011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:05.453415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-154e0948-9ce6-45d2-9b42-c1e2c3865045 None None] MFA Rules not processed for user `777bed5cc15243449cca839b29d13db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:05.454691 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-154e0948-9ce6-45d2-9b42-c1e2c3865045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:05.546874 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1406/2783] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:05.566034 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:05.567835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:05.590255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:05.693982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c587bf-7b78-4b24-a7fb-ffd76df05677 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:05.700123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:05.700818 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:05.701170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:05.701666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:05.714318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:05.716157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059207e-7a29-492c-8245-40df32a5bbd8 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:05.733590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1378/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:06.024010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959ca8-5556-446e-974e-048607bb00ef None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:06.024010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959ca8-5556-446e-974e-048607bb00ef None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:06.024663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959ca8-5556-446e-974e-048607bb00ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:06.079429 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-89959ca8-5556-446e-974e-048607bb00ef None None] MFA Rules not processed for user `c84518a65e764ec28036fd39d316ce3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:06.081774 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-89959ca8-5556-446e-974e-048607bb00ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:06.183512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1407/2785] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:07.163995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:07.164646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:07.164646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:07.196531 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] MFA Rules not processed for user `777bed5cc15243449cca839b29d13db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:07.198757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:07.205555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1379/2786] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:07.287147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959ca8-5556-446e-974e-048607bb00ef None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:07.367329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959ca8-5556-446e-974e-048607bb00ef None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:07.372766 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:07.373681 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:07.373994 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:07.374460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] PATH_INFO: `/v3/users/e77a086c330c42cf9ea172cab113283c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:07.375669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77a086c330c42cf9ea172cab113283c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:07.377644 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:07.402343 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:07.432073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77a086c330c42cf9ea172cab113283c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.440792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77a086c330c42cf9ea172cab113283c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.441586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77a086c330c42cf9ea172cab113283c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.443091 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77a086c330c42cf9ea172cab113283c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.453090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77a086c330c42cf9ea172cab113283c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.473017 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1408/2787] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:07 2022] DELETE /identity/v3/users/e77a086c330c42cf9ea172cab113283c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:07.730446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:07.745023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951fac5-49dc-4cd6-aa6b-07221ea3e8f8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:07.837904 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:07.838823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:07.839163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:07.839501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] PATH_INFO: `/v3/projects/1779038a744d4647a3ecaaa4cf4d6ce8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:07.840767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1779038a744d4647a3ecaaa4cf4d6ce8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:07.843021 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:07.911035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1779038a744d4647a3ecaaa4cf4d6ce8', 'request_id': 'req-b6fcc011-7b8d-4e79-9dce-251752a9835a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.923196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1779038a744d4647a3ecaaa4cf4d6ce8', 'request_id': 'req-b6fcc011-7b8d-4e79-9dce-251752a9835a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.931226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1779038a744d4647a3ecaaa4cf4d6ce8', 'request_id': 'req-b6fcc011-7b8d-4e79-9dce-251752a9835a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.944987 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] The token cache is being invalidate because project 1779038a744d4647a3ecaaa4cf4d6ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:07.945269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.946510 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:07.948066 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1380/2788] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:07 2022] DELETE /identity/v3/projects/1779038a744d4647a3ecaaa4cf4d6ce8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:07.953045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:07.954892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:07.969095 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848028f-15c9-44b5-b750-bd5c3e311a8e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.033721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.034421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.034738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.035012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] PATH_INFO: `/v3/users/c84518a65e764ec28036fd39d316ce3d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.036545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84518a65e764ec28036fd39d316ce3d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.038633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.093338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84518a65e764ec28036fd39d316ce3d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.101790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84518a65e764ec28036fd39d316ce3d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.102500 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84518a65e764ec28036fd39d316ce3d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.103458 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84518a65e764ec28036fd39d316ce3d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.111097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f239b72-8feb-4eae-9828-d92f835b770f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84518a65e764ec28036fd39d316ce3d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.134767 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1409/2789] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:07 2022] DELETE /identity/v3/users/c84518a65e764ec28036fd39d316ce3d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:08.316121 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.317966 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:08.332733 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcc011-7b8d-4e79-9dce-251752a9835a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.348036 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:08.412001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.412687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.412961 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.413232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] PATH_INFO: `/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.414360 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e92a434d3a484bb5f2fd062ff07c00)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.416249 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.475550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e92a434d3a484bb5f2fd062ff07c00', 'request_id': 'req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.485565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e92a434d3a484bb5f2fd062ff07c00', 'request_id': 'req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.493010 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e92a434d3a484bb5f2fd062ff07c00', 'request_id': 'req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.505161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] The token cache is being invalidate because project c2e92a434d3a484bb5f2fd062ff07c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:08.505451 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.506169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9b2fa5ac-9318-485c-b8ed-c08f6aa5c246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:08.508410 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1381/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:08 2022] DELETE /identity/v3/projects/c2e92a434d3a484bb5f2fd062ff07c00 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:08.513461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.513970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.514090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.535009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:08.536471 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:08.549596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:08.605509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1410/2791] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:08.613271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.613555 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.613830 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.635349 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:08.636761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:08.646126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1382/2792] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:08.650587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.660819 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07754-ef82-4937-a99b-20998887d4fc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.665498 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.666101 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.666372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.666666 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.667330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:22:08.667623 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.669216 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.684323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1411/2793] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:22:08.688660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.699094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfedb4-fa3d-42e5-925f-007e363ef65d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.704488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.705087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.705364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.705750 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.706307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.708226 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.741401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1383/2794] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:08 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:08.745551 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.757129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0e03-735b-4977-b364-aeb5135a1aad admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.821524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.822170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.822442 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.822827 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.823366 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.825279 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.848783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1412/2795] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:08 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:08.853646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.864293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a0737-f12a-4544-a9da-f773eb892c0f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.869761 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.870380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.870702 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.870956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.871625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.873295 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.884611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1384/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:08.888904 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.899721 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dc60a-2bf4-443f-8a1d-f826deb50d8d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.904510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.905281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.905883 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.906136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.907075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.908877 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbced4-a043-4bc1-8201-7e09084637bb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:08.924549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1413/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:08.929418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:08.942023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10290-4b33-44ea-bdd9-012269930bd3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:08.949852 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:08.951067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:08.951586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:08.952037 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] PATH_INFO: `/v3/projects/92d78deb9d914d2e94d7beaf89b14612/users/6baea962f2a34e32b50bd6f3efc3852e/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:08.981357 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d78deb9d914d2e94d7beaf89b14612, user_id=6baea962f2a34e32b50bd6f3efc3852e, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:08.986304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.006871 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1385/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:08 2022] PUT /identity/v3/projects/92d78deb9d914d2e94d7beaf89b14612/users/6baea962f2a34e32b50bd6f3efc3852e/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:09.020021 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.020928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.023325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.080531 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] MFA Rules not processed for user `6baea962f2a34e32b50bd6f3efc3852e`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:09.082166 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:09.214012 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1414/2799] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:09.218278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.283365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:09.317399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1c8d-ea85-4742-a707-84b81b6fcb73 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.327399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.327399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.327971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.328476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.329647 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.333492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.379910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1386/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:09 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:09.384735 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.396791 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a678-29a7-40c2-bc12-31bbdff4813b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.407243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:09.459894 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.460778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.461237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.461559 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.462234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.464262 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.488179 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1415/2801] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:09 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:22:09.489497 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.500610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c128927-0763-4dc7-8b71-e6fd31d5e521 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.505518 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.507094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.507387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.507663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.508524 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.510128 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.521808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1387/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:09.525978 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.536493 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea196b-9f66-4247-80ce-7491b58cd0db admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.541182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.541826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.542106 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.542379 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] PATH_INFO: `/v3/projects/c5961776744b434b830c043bf642f463/users/cd1e4c5146214c77886a1c3eac8e7398/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.560045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5961776744b434b830c043bf642f463, user_id=cd1e4c5146214c77886a1c3eac8e7398, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.562750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.578866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1416/2803] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:09 2022] PUT /identity/v3/projects/c5961776744b434b830c043bf642f463/users/cd1e4c5146214c77886a1c3eac8e7398/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:09.582417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.592507 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1afc3-4490-4123-aa56-3ca43d03862a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.652866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.653582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.653862 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.654133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.654820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.657047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305a664-7f14-4593-aff8-7f4172316264 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.668199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1388/2804] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:09.672462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.685086 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e59d7-b1c8-47cd-8cee-0eda3a885687 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.690328 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.691170 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.691745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.691745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] PATH_INFO: `/v3/projects/c5961776744b434b830c043bf642f463/users/cd1e4c5146214c77886a1c3eac8e7398/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.693941 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5961776744b434b830c043bf642f463, user_id=cd1e4c5146214c77886a1c3eac8e7398, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.696684 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.708261 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1417/2805] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:09 2022] PUT /identity/v3/projects/c5961776744b434b830c043bf642f463/users/cd1e4c5146214c77886a1c3eac8e7398/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:09.720452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.721461 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.721753 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.757234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] MFA Rules not processed for user `cd1e4c5146214c77886a1c3eac8e7398`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:09.758642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:09.837955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1389/2806] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:09.849243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:09.851569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:09.916126 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4b7-3365-4ec8-a895-f9ad68cc6459 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:09.919707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:09.920301 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:09.920573 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:09.920844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:09.931768 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:09.933211 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28171988-0fb8-4614-9a61-a56f5634b54c service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:09.942942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1418/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:22:10.024178 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:10.036359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ff71-5514-45f6-8224-60e556b252a8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:10.039900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:10.040500 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:10.040770 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:10.041035 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:10.088463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:10.123059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:10.125150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:10.135293 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1390/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:19.938885 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:20.130955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=11 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:33.796866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b97ea-9a60-43bb-9bf0-8cc14441298a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:33.797476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b97ea-9a60-43bb-9bf0-8cc14441298a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:33.797476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b97ea-9a60-43bb-9bf0-8cc14441298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:33.817199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f99b97ea-9a60-43bb-9bf0-8cc14441298a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:33.818436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f99b97ea-9a60-43bb-9bf0-8cc14441298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:33.878419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1419/2809] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:33.899493 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:33.900968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:34.005936 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10fd1-171c-4b10-b0a5-e5afbb2342a5 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:34.012195 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:34.012861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:34.013165 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:34.013467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:34.023737 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:34.026098 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:34.036161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1391/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:36.836655 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85fb5-e062-47f1-81f9-9d60bc9b04a9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:36.837099 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85fb5-e062-47f1-81f9-9d60bc9b04a9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:36.837214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85fb5-e062-47f1-81f9-9d60bc9b04a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:36.857409 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7cd85fb5-e062-47f1-81f9-9d60bc9b04a9 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:36.858651 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7cd85fb5-e062-47f1-81f9-9d60bc9b04a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:36.867097 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1420/2811] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:36.881636 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:36.883127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:36.897949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013748-781a-4a3f-ae2c-7000501306ec service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:36.903387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:36.903985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:36.904260 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:36.904529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:36.914080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:36.915773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:36.925341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1392/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:40.193148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:40.193846 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:40.194009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:40.216353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:40.217723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:40.226756 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1421/2813] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:40.241910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:40.254667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951224f-fea2-49e3-ac06-71c6fd0eea33 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:40.260740 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:40.261401 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:40.261942 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:40.262279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:40.272011 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:40.273652 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71b46-e55e-4501-ab80-336e6c9be275 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:40.283697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1393/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:40.318624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:40.331084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d7660-f6ba-44be-86a0-ab68e505869f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:40.337122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:40.337861 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:40.338222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:40.338524 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] PATH_INFO: `/v3/users/6baea962f2a34e32b50bd6f3efc3852e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:40.339844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6baea962f2a34e32b50bd6f3efc3852e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:40.341999 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:40.414051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6baea962f2a34e32b50bd6f3efc3852e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:40.423582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6baea962f2a34e32b50bd6f3efc3852e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:40.424218 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6baea962f2a34e32b50bd6f3efc3852e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:40.424843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6baea962f2a34e32b50bd6f3efc3852e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:40.432866 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6baea962f2a34e32b50bd6f3efc3852e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:40.455561 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1422/2815] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:40 2022] DELETE /identity/v3/users/6baea962f2a34e32b50bd6f3efc3852e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:40.463162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:40.463480 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:40.463886 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:40.491858 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:40.493088 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:40.560162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1394/2816] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:40.570933 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:40.572462 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:40.639084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9719ae-c4f6-47ad-9269-43caa145315e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:40.642773 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:40.643378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:40.643654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:40.643925 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:40.654958 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:40.656404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:40.667295 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1423/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:41.201271 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:41.203168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:41.215971 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892dffb-1757-4cf8-9c02-6f76cc05114c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:41.220955 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:41.221607 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:41.221884 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:41.222159 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] PATH_INFO: `/v3/projects/92d78deb9d914d2e94d7beaf89b14612` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:41.223968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d78deb9d914d2e94d7beaf89b14612)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:41.225755 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:41.266520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:41.279419 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d78deb9d914d2e94d7beaf89b14612', 'request_id': 'req-ba8dc5f2-cc80-486a-aa8d-05194d198966'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.293532 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d78deb9d914d2e94d7beaf89b14612', 'request_id': 'req-ba8dc5f2-cc80-486a-aa8d-05194d198966'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.300639 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d78deb9d914d2e94d7beaf89b14612', 'request_id': 'req-ba8dc5f2-cc80-486a-aa8d-05194d198966'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.313224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] The token cache is being invalidate because project 92d78deb9d914d2e94d7beaf89b14612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:41.313611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.314214 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.315738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1395/2818] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:41 2022] DELETE /identity/v3/projects/92d78deb9d914d2e94d7beaf89b14612 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:41.319840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:41.324903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:41.330871 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef24b9-47ab-4d60-8fa1-bba40db221f6 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:41.408602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:41.409234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:41.409776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:41.410045 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] PATH_INFO: `/v3/users/cd1e4c5146214c77886a1c3eac8e7398` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:41.411792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1e4c5146214c77886a1c3eac8e7398)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:41.413687 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:41.469745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1e4c5146214c77886a1c3eac8e7398'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.479582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1e4c5146214c77886a1c3eac8e7398'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.480254 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1e4c5146214c77886a1c3eac8e7398'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.481067 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1e4c5146214c77886a1c3eac8e7398'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.490972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-20e6c99c-d46d-4c2e-ac77-dce1ea12aa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1e4c5146214c77886a1c3eac8e7398'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:41.512769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1424/2819] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:41 2022] DELETE /identity/v3/users/cd1e4c5146214c77886a1c3eac8e7398 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:41.871721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:41.873201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:41.890814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dc5f2-cc80-486a-aa8d-05194d198966 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:41.971697 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:41.972342 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:41.972612 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:41.972882 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] PATH_INFO: `/v3/projects/c5961776744b434b830c043bf642f463` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:41.974198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5961776744b434b830c043bf642f463)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:41.976184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.024347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5961776744b434b830c043bf642f463', 'request_id': 'req-e0878acb-9754-4523-8092-4238f306700c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:42.032390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5961776744b434b830c043bf642f463', 'request_id': 'req-e0878acb-9754-4523-8092-4238f306700c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:42.038502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5961776744b434b830c043bf642f463', 'request_id': 'req-e0878acb-9754-4523-8092-4238f306700c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:42.049736 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] The token cache is being invalidate because project c5961776744b434b830c043bf642f463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:42.050020 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:42.050695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0878acb-9754-4523-8092-4238f306700c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:42.052168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1396/2820] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:41 2022] DELETE /identity/v3/projects/c5961776744b434b830c043bf642f463 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:42.057546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.057828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.058102 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.078582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:42.079793 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:42.154213 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1425/2821] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:42.163561 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.163959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.164505 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.186082 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:42.187324 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:42.196234 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1397/2822] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:42.200332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.211363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade805a-b8fc-4110-857b-199f189e048f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.215967 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.216568 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.216843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.217114 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.217760 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:22:42.218054 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.219678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.231621 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1426/2823] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:22:42.236078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.246425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf21fa-4f2a-40a4-8c5d-0fd29ea85761 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.251106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.251735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.252013 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.252286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.252928 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.255506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.282720 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1398/2824] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:42.287457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.298826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930f05-f560-4410-ad19-8a1ec538c2e2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.304744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:42.359844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.360692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.360692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.361042 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.361578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.363549 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.387695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1427/2825] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:42.392449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.406562 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a2e9-118a-4fba-9686-2ad01d05e52c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.412087 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.412787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.413180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.413494 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.414186 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.416019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.427403 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1399/2826] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:42.432580 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.447757 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38530-807b-4f50-8277-bf94bd8b0063 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.454436 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.455288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.455626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.456236 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.457387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.460020 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c9d5-0456-45b4-8ee5-a1b8ba23c962 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.479615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1428/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:42.481184 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.492528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc995-e1c7-4495-9746-cfe80a752705 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.497312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.498003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.498285 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.498625 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] PATH_INFO: `/v3/projects/48ce0ccd9fd142579ff34a564668adcb/users/66145208c6354c208b63a497d732d771/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.511094 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:42.515694 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ce0ccd9fd142579ff34a564668adcb, user_id=66145208c6354c208b63a497d732d771, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.519081 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.533580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1400/2828] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:42 2022] PUT /identity/v3/projects/48ce0ccd9fd142579ff34a564668adcb/users/66145208c6354c208b63a497d732d771/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:42.545685 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.546051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.546324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.578107 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] MFA Rules not processed for user `66145208c6354c208b63a497d732d771`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:42.579408 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:42.654606 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1429/2829] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:42.659306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.723940 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e2bc1-ad1d-4c67-8e88-ecbff92affd7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.728634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.729237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.729513 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.729786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.730413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.732418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.761139 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1401/2830] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:42.765286 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.776515 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b965-134b-4296-a9ca-8aded7f182f3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.834192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.834824 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.835105 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.835382 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.836004 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.837928 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.860483 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1430/2831] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:42 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:42.865326 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.881242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea039169-454f-4d76-b3da-71c0e290e9e4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.888290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.889174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.889621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.890047 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.891101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.893775 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.905126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1402/2832] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:42.909868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.921415 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c4748-3ee6-417a-a558-8ff3984d729e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:42.926508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:42.927801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:42.928147 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:42.928529 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] PATH_INFO: `/v3/projects/6ef699f3d22e4250955af82af4a11e0c/users/c7cf8d904a2d447790a9d41082a5e0b1/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:42.931108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:42.947009 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef699f3d22e4250955af82af4a11e0c, user_id=c7cf8d904a2d447790a9d41082a5e0b1, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:42.949845 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:42.963323 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1431/2833] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:42 2022] PUT /identity/v3/projects/6ef699f3d22e4250955af82af4a11e0c/users/c7cf8d904a2d447790a9d41082a5e0b1/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:42.967359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:42.978313 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9eb80-c721-4c8e-b7ae-7760f4f5f1d7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:43.040717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:43.041336 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.041611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.041877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.042542 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:43.044134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831efdb-0185-4566-b64f-8c54ec43c022 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:43.054709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1403/2834] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:43.059466 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:43.071281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfa083-e847-465b-9c3d-03fed52119f8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:43.076182 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:43.076849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.077122 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.077387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] PATH_INFO: `/v3/projects/6ef699f3d22e4250955af82af4a11e0c/users/c7cf8d904a2d447790a9d41082a5e0b1/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.079383 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef699f3d22e4250955af82af4a11e0c, user_id=c7cf8d904a2d447790a9d41082a5e0b1, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:43.082206 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:43.094906 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1432/2835] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:43 2022] PUT /identity/v3/projects/6ef699f3d22e4250955af82af4a11e0c/users/c7cf8d904a2d447790a9d41082a5e0b1/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:43.105907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5b83-c1a0-4f07-83d8-4c115158f34c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.106187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5b83-c1a0-4f07-83d8-4c115158f34c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.106456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5b83-c1a0-4f07-83d8-4c115158f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.142817 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-13ce5b83-c1a0-4f07-83d8-4c115158f34c None None] MFA Rules not processed for user `c7cf8d904a2d447790a9d41082a5e0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:43.144330 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-13ce5b83-c1a0-4f07-83d8-4c115158f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:43.196467 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:43.230959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1404/2836] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:43.243094 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:43.245135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:43.282371 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.282700 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.282965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.306780 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:43.308190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:43.310752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be1a25-e673-4520-9beb-9a8b5dca9194 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:43.314530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:43.315144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.315423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.315692 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.325329 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:43.326805 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:43.339497 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1433/2837] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:43.385272 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1405/2838] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:43.405167 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:43.406826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:43.433463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:43.443954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369801f4-63a1-4a5d-bbf6-ef65f7de3c17 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:43.447946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:43.448754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.449038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.449452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.501880 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98e0a-93b7-4a02-9cd4-79dc1fc5fa43 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:43.507974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:43.508582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:43.508859 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:43.509130 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:43.513456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:43.514956 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:43.518214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:43.521212 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615426e1-7035-43b1-ab4b-ddbfb300d736 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:43.524791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1406/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:22:43.532596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1434/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:49.718580 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:49.729594 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1217d-170d-4ad7-88bd-858da57b91a0 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:49.734402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:49.735127 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:49.735353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:49.735660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] PATH_INFO: `/v3/users/66145208c6354c208b63a497d732d771` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:49.737069 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66145208c6354c208b63a497d732d771)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:49.740155 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:49.798438 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66145208c6354c208b63a497d732d771'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:49.808133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66145208c6354c208b63a497d732d771'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:49.808767 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66145208c6354c208b63a497d732d771'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:49.809484 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66145208c6354c208b63a497d732d771'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:49.818957 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66145208c6354c208b63a497d732d771'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:49.831003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:49.840408 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1407/2841] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:49 2022] DELETE /identity/v3/users/66145208c6354c208b63a497d732d771 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:49.845546 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:49.846753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:49.846753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:49.872180 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:49.873350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:49.930504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:49.942826 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1435/2842] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:49.952977 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:49.954434 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:50.026100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0e1a6-c04f-40a7-aec3-0b05ad26c8c1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:50.030100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:50.030754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:50.033407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:50.033407 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:50.044050 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:50.045529 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:50.070501 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1408/2843] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:50.386584 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:50.388135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:50.402144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa364dd-2680-4d2d-8683-72c19bd73ab4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:50.407253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:50.407898 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:50.408172 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:50.408441 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] PATH_INFO: `/v3/projects/48ce0ccd9fd142579ff34a564668adcb` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:50.409858 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ce0ccd9fd142579ff34a564668adcb)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:50.412303 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:50.466362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ce0ccd9fd142579ff34a564668adcb', 'request_id': 'req-11ab37d3-a48d-475e-abd8-6692c7018591'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.478132 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ce0ccd9fd142579ff34a564668adcb', 'request_id': 'req-11ab37d3-a48d-475e-abd8-6692c7018591'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.485557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ce0ccd9fd142579ff34a564668adcb', 'request_id': 'req-11ab37d3-a48d-475e-abd8-6692c7018591'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.499727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] The token cache is being invalidate because project 48ce0ccd9fd142579ff34a564668adcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:50.500133 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.500822 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.502297 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1436/2844] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:50 2022] DELETE /identity/v3/projects/48ce0ccd9fd142579ff34a564668adcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:50.506791 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:50.516781 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcaab-3dd1-4419-9d37-5ec246b1fb6b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:50.586498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:50.587208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:50.587489 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:50.587759 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] PATH_INFO: `/v3/users/c7cf8d904a2d447790a9d41082a5e0b1` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:50.589085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cf8d904a2d447790a9d41082a5e0b1)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:50.591289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:50.641084 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cf8d904a2d447790a9d41082a5e0b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.649680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cf8d904a2d447790a9d41082a5e0b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.650523 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cf8d904a2d447790a9d41082a5e0b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.651171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cf8d904a2d447790a9d41082a5e0b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.663601 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1a295cce-bc1f-4835-8b38-3b64b0a5cc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cf8d904a2d447790a9d41082a5e0b1'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:50.688757 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1409/2845] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:22:50 2022] DELETE /identity/v3/users/c7cf8d904a2d447790a9d41082a5e0b1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:51.013240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.015085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.031686 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab37d3-a48d-475e-abd8-6692c7018591 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.110010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.110701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.110990 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.111259 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] PATH_INFO: `/v3/projects/6ef699f3d22e4250955af82af4a11e0c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.112404 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef699f3d22e4250955af82af4a11e0c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.114374 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.171452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef699f3d22e4250955af82af4a11e0c', 'request_id': 'req-3c196d7d-c74f-4bed-b96d-1311baa28609'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:51.181292 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef699f3d22e4250955af82af4a11e0c', 'request_id': 'req-3c196d7d-c74f-4bed-b96d-1311baa28609'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:51.188052 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef699f3d22e4250955af82af4a11e0c', 'request_id': 'req-3c196d7d-c74f-4bed-b96d-1311baa28609'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:51.202538 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] The token cache is being invalidate because project 6ef699f3d22e4250955af82af4a11e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:22:51.202834 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:51.203496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3c196d7d-c74f-4bed-b96d-1311baa28609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:22:51.204984 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1437/2846] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:22:51 2022] DELETE /identity/v3/projects/6ef699f3d22e4250955af82af4a11e0c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:51.210905 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.211706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.211706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.232463 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:51.233695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.248171 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:51.310870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1410/2847] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:51.320215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.320504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.320778 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.340865 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:51.342078 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.350240 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1438/2848] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:51.357306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.369595 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39624-1ca7-40c8-8c77-0452e545bec0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.374610 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.375230 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.375486 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.375752 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.376426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:22:51.376710 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.378366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.396078 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1411/2849] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:22:51.400772 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.406421 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:51.410839 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4c988-66b5-4ee3-abd7-c80f4efca91c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.417416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.418419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.418864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.419690 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.420424 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.422688 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.451603 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1439/2850] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:51.455782 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.466061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448dc7a-59f1-425f-bb3d-d6e3758bb050 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.528888 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.529348 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.529618 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.529880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.530550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.532577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.556982 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1412/2851] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:51.561416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.575245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e92e-f324-4f65-befb-4599f2315872 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.580472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.581192 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.581496 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.581770 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.582423 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.584258 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dae81-f686-409f-ba8c-a2c095271425 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.596482 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1440/2852] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:51.601911 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.618232 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bed4ce-42c4-45c6-b327-1ef51874844f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.623488 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.624118 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.624387 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.624654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.625323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.625525 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.625811 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.626142 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.626983 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.638533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1413/2853] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:22:51.642832 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.646115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:51.647353 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.652985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8543-8bf2-4295-8650-963367e6a2d9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.655416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1441/2854] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:51.658445 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.658620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.658866 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.659133 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] PATH_INFO: `/v3/projects/edfaf67b984b4983b66d63605272608d/users/aba9fb480c1446da8ca16373821f370a/roles/a91a89818523427f9295a540fa435066` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.678743 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfaf67b984b4983b66d63605272608d, user_id=aba9fb480c1446da8ca16373821f370a, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.680465 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.681611 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea94522-08cf-486e-a667-85333fedafba admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.682073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.695958 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1414/2855] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:51 2022] PUT /identity/v3/projects/edfaf67b984b4983b66d63605272608d/users/aba9fb480c1446da8ca16373821f370a/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:22:51.700739 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.701019 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.701292 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.721409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:51.725582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.762750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7fb3-5cbe-4be9-be0c-06c4f17d3849 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.783170 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:51.796215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1415/2856] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:51.807366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:51.808969 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:51.831663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.832204 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.832460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.832742 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.841338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.842989 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92613b13-f71c-4287-b330-e677b2437797 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.853177 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1442/2857] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:22:51.874654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f311-9274-4387-a1e4-b522e76092d2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:51.878425 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:51.879365 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:51.879642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:51.879915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:51.891550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:51.893238 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:51.905320 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1416/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:22:52.639659 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:52.640230 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:52.640472 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:52.684776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] MFA Rules not processed for user `aba9fb480c1446da8ca16373821f370a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:52.685899 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:52.729955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:52.783660 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1443/2859] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:52.790224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:52.811104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8162-0b20-498a-973c-5f035c4cc6d4 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:52.824939 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:52.828001 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:52.829379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:52.829379 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:52.833126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:52.835599 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:52.878617 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1417/2860] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:22:52 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:52.883776 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:52.905706 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a746a-37ee-4551-96a2-2a99e438698a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:52.987537 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:52.988981 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:52.989350 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:52.989695 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:52.990777 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:52.993663 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:53.021618 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1444/2861] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:22:52 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:22:53.025945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:53.037279 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0374-a52f-4092-9a6d-6cdb35b18d1a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:53.042766 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:53.043380 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:53.043654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:53.043922 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:53.044578 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:53.046151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:53.058000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1418/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:22:53.062823 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:53.075245 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b406625-fbfd-41f6-826f-ab502c70d32d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:53.080193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:53.080854 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:53.081162 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:53.081434 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] PATH_INFO: `/v3/projects/360cfe74134f49099ab1837bf0e8f3ec/users/91c5d421d86b411f99252619f46bd295/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:53.103280 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=360cfe74134f49099ab1837bf0e8f3ec, user_id=91c5d421d86b411f99252619f46bd295, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:53.106949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:53.122557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1445/2863] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:53 2022] PUT /identity/v3/projects/360cfe74134f49099ab1837bf0e8f3ec/users/91c5d421d86b411f99252619f46bd295/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:53.129187 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:53.140334 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a1f4-7777-4a3f-ace9-2ebe2293db17 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:53.213208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:53.213839 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:53.214162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:53.214428 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:53.215103 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:53.216695 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c3ddb-353a-4b54-ab49-ad41db12241b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:53.227643 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1419/2864] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:22:53.233361 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:53.246814 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0bfe-76ba-41b8-826b-845b57f9d95f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:53.252675 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:53.253332 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:53.253608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:53.253879 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] PATH_INFO: `/v3/projects/360cfe74134f49099ab1837bf0e8f3ec/users/91c5d421d86b411f99252619f46bd295/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:53.255893 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360cfe74134f49099ab1837bf0e8f3ec, user_id=91c5d421d86b411f99252619f46bd295, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:53.258556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7b12-d1f0-4c13-8646-a677caa98150 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:53.269356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1446/2865] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:22:53 2022] PUT /identity/v3/projects/360cfe74134f49099ab1837bf0e8f3ec/users/91c5d421d86b411f99252619f46bd295/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:22:54.018668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:54.019201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:54.019314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:54.059754 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] MFA Rules not processed for user `91c5d421d86b411f99252619f46bd295`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:54.061101 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:54.151162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:54.190634 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1420/2866] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:54.205662 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79210c5-63bc-433b-ab6f-654b5e9a8a49 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:54.206567 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79210c5-63bc-433b-ab6f-654b5e9a8a49 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:54.206843 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79210c5-63bc-433b-ab6f-654b5e9a8a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:54.229725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f79210c5-63bc-433b-ab6f-654b5e9a8a49 None None] MFA Rules not processed for user `aba9fb480c1446da8ca16373821f370a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:54.230808 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f79210c5-63bc-433b-ab6f-654b5e9a8a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:54.303090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1447/2867] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:22:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:22:54.318239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:54.320122 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:54.406680 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f03c0-d8aa-46ba-b589-44667ec50820 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:54.413621 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:54.414359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:54.414730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:54.415110 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:54.424591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:54.427061 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:54.437323 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1421/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:22:54.837631 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:54.838144 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:54.838565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:54.869647 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:22:54.870909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:22:54.903274 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:22:54.939281 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1448/2869] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:22:54.955769 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:22:54.967448 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3879-7ebc-4426-b598-a106cc4045fb service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:22:54.973985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:22:54.974688 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:22:54.975046 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:22:54.975384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:22:54.985442 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:22:54.987243 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004c393-d1c0-43c1-bf86-394d0ee41a31 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:22:54.998631 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1422/2870] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:04.930614 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=11 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:04.994136 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=44 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:09.112929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:09.112929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:09.170197 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9e74e-f94f-4136-8624-fc980dbdcd5a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:09.174554 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:09.175632 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:09.175903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:09.176199 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:09.185944 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:09.187405 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffa77b-8346-4989-b44a-96f3f17c75fd service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:09.197247 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1449/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:11.697449 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:11.698043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:11.698043 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:11.719052 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] MFA Rules not processed for user `777bed5cc15243449cca839b29d13db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:11.720304 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:11.778988 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1423/2872] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:19.193141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=26 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:21.772224 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=25 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:23.590804 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b392f7-0e3a-49e4-a67c-a8a0363e4319 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:23.591380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b392f7-0e3a-49e4-a67c-a8a0363e4319 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:23.591380 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b392f7-0e3a-49e4-a67c-a8a0363e4319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:23.610411 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-51b392f7-0e3a-49e4-a67c-a8a0363e4319 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:23.611622 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-51b392f7-0e3a-49e4-a67c-a8a0363e4319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:23.619393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1450/2873] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:23.637582 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:23.651162 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0c12-3fdb-48d1-902a-e03749065e30 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:23.656591 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:23.657192 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:23.657466 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:23.657735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:23.666975 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:23.668540 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:23.678747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1424/2874] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:26.851363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:26.851948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:26.851948 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:26.872334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:26.873536 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:26.882239 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1451/2875] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:23:26.904307 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:26.915717 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbcb28-72ed-480d-9f9a-2bd183f12210 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:26.921074 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:26.921684 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:26.921960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:26.922231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:26.931687 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:26.933240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:26.943976 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1425/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:29.502979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:29.514566 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b705c3f-d729-4426-8d82-21bf078c0aa0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:29.519649 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:29.520291 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:29.520597 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:29.520864 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] PATH_INFO: `/v3/users/aba9fb480c1446da8ca16373821f370a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:29.521979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba9fb480c1446da8ca16373821f370a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:29.524096 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:29.571333 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba9fb480c1446da8ca16373821f370a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.578271 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba9fb480c1446da8ca16373821f370a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.578908 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba9fb480c1446da8ca16373821f370a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.579508 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba9fb480c1446da8ca16373821f370a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.586451 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba9fb480c1446da8ca16373821f370a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.603912 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1452/2877] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:23:29 2022] DELETE /identity/v3/users/aba9fb480c1446da8ca16373821f370a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:29.778538 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:29.790861 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d5f44-7350-4246-8a85-f4c138398e32 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:29.857267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:29.857891 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:29.858163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:29.858511 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] PATH_INFO: `/v3/projects/edfaf67b984b4983b66d63605272608d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:29.859593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfaf67b984b4983b66d63605272608d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:29.861452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:29.912661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfaf67b984b4983b66d63605272608d', 'request_id': 'req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.921355 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfaf67b984b4983b66d63605272608d', 'request_id': 'req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.928446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfaf67b984b4983b66d63605272608d', 'request_id': 'req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.940059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] The token cache is being invalidate because project edfaf67b984b4983b66d63605272608d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:23:29.940492 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.941575 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fd3e4808-2fbb-4982-98f2-72b02dc1fcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:29.943282 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1426/2878] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:23:29 2022] DELETE /identity/v3/projects/edfaf67b984b4983b66d63605272608d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:29.947219 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:29.948633 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:29.962648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5681-8600-41ce-bb51-37a913d8cc78 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:29.965430 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:29.966079 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:29.966670 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:29.987820 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:29.989163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.038701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.039334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.039607 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.039875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] PATH_INFO: `/v3/users/91c5d421d86b411f99252619f46bd295` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.041013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c5d421d86b411f99252619f46bd295)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.042974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.055807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1427/2879] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:30.074418 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.076560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.084827 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:30.100420 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c5d421d86b411f99252619f46bd295'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.108117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c5d421d86b411f99252619f46bd295'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.109002 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c5d421d86b411f99252619f46bd295'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.109962 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c5d421d86b411f99252619f46bd295'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.116136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:30.118352 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c5d421d86b411f99252619f46bd295'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.146517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1453/2880] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:23:29 2022] DELETE /identity/v3/users/91c5d421d86b411f99252619f46bd295 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:30.164995 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c930a-fb36-4c8d-b881-6d84ad016f76 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.233456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.234080 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.234364 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.234672 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.236608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.304814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.306560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ef78-5872-4484-bc9e-84e0089551ae service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.318502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1428/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:23:30.329363 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.330918 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.345454 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da28c0-7b8d-4478-a533-68c17f1ae950 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.350585 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.351288 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.351628 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.351970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] PATH_INFO: `/v3/projects/360cfe74134f49099ab1837bf0e8f3ec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.361705 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360cfe74134f49099ab1837bf0e8f3ec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.365356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.425275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360cfe74134f49099ab1837bf0e8f3ec', 'request_id': 'req-34041388-c4ad-4696-becf-f4a3da784d99'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.433672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360cfe74134f49099ab1837bf0e8f3ec', 'request_id': 'req-34041388-c4ad-4696-becf-f4a3da784d99'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.440771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360cfe74134f49099ab1837bf0e8f3ec', 'request_id': 'req-34041388-c4ad-4696-becf-f4a3da784d99'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.459221 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] The token cache is being invalidate because project 360cfe74134f49099ab1837bf0e8f3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:23:30.459501 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.460222 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-34041388-c4ad-4696-becf-f4a3da784d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:30.461728 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1454/2882] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:23:30 2022] DELETE /identity/v3/projects/360cfe74134f49099ab1837bf0e8f3ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:30.467397 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.467683 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.467959 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.489577 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:30.490960 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.523570 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:30.562677 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1429/2883] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:30.571115 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.571575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.571720 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.592998 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:30.594215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:30.602140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1455/2884] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:30.606399 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.616709 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3350-5403-4e99-8f22-25ff85bec303 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.621237 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.621828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.622104 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.622369 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.623054 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:23:30.623347 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.624933 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.638663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1430/2885] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:23:30.643672 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.653838 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160465ee-08d3-4959-a7cb-d4729e150b8e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.658849 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.659445 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.659719 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.659983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.660613 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.662512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.691378 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1456/2886] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:23:30 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:23:30.695889 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.706199 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50345a-e24e-4260-b80b-01feb646cf3f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.768421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.769029 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.769296 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.769565 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.770231 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.772190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.795949 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1431/2887] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:23:30 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:23:30.800140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.811783 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa532-7cdd-4297-aefc-fc69856083bc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.816532 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.817809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.818075 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.818337 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.819007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.820608 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.831118 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1457/2888] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:30.835498 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.846476 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f63a-054c-4c59-b5a2-278bb34bb17c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.852073 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.852352 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.852630 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.852926 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.853593 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.855246 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf41d0b-75b7-40b6-ae4e-b54d95f867c2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.866793 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1432/2889] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:30.870971 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:30.881830 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497b94f-b8f4-4380-962e-39719d27501b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:30.886669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:30.887324 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.887596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.887868 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] PATH_INFO: `/v3/projects/0317ef566f164e5592d7bcfaf528e655/users/c4fd68b1533743779078186db8f40634/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:30.903161 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0317ef566f164e5592d7bcfaf528e655, user_id=c4fd68b1533743779078186db8f40634, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:30.905870 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:30.921364 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1458/2890] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:23:30 2022] PUT /identity/v3/projects/0317ef566f164e5592d7bcfaf528e655/users/c4fd68b1533743779078186db8f40634/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:30.989353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:30.989721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:30.990003 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.020520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] MFA Rules not processed for user `c4fd68b1533743779078186db8f40634`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:31.021730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:31.100335 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1433/2891] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:31.105000 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.163924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:31.167790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5988a9-0286-4d42-9199-16224301a4b6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.174873 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.175911 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.176407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.176738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.177596 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.179711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.217569 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1459/2892] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:23:31 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:23:31.221465 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.234115 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d53985-b510-49ce-a72f-010bee22b336 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.278506 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:31.311581 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.312190 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.312458 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.312721 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.313358 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.315287 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.339867 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1434/2893] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:23:31 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:23:31.345039 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.356626 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993f856-f602-4e1c-9efe-1d6afa4a0ef8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.361587 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.362193 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.362464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.362782 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.363419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.365552 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.377006 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1460/2894] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:31.382536 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.393679 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73780cb-1c08-442f-a08d-f3661eefc475 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.399934 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.400620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.400910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.401161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] PATH_INFO: `/v3/projects/323901c9341a4038943915f3c8d4d816/users/58f08358eb494d29a469235cb9671d1e/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.416787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=323901c9341a4038943915f3c8d4d816, user_id=58f08358eb494d29a469235cb9671d1e, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.419456 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.433836 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1435/2895] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:23:31 2022] PUT /identity/v3/projects/323901c9341a4038943915f3c8d4d816/users/58f08358eb494d29a469235cb9671d1e/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:31.438038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.449084 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f038-55e5-4618-93da-cf4aa70f7478 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.509185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.509701 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.509979 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.510253 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.510939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.512547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8227c9c-ef84-42f9-b3c4-77d25e33fe96 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.523661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1461/2896] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:31.528341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.539609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b16a6-f920-4a79-bcdb-906fa119fa6c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.545378 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.546194 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.546477 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.546779 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] PATH_INFO: `/v3/projects/323901c9341a4038943915f3c8d4d816/users/58f08358eb494d29a469235cb9671d1e/roles/2838a4268e68454e8e20940d4f2b5800` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.548735 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323901c9341a4038943915f3c8d4d816, user_id=58f08358eb494d29a469235cb9671d1e, role_id=2838a4268e68454e8e20940d4f2b5800)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.552005 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.562900 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1436/2897] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:23:31 2022] PUT /identity/v3/projects/323901c9341a4038943915f3c8d4d816/users/58f08358eb494d29a469235cb9671d1e/roles/2838a4268e68454e8e20940d4f2b5800 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:23:31.573648 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198ccac-e2ce-4a7a-bb89-a5cee47ea675 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.574152 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198ccac-e2ce-4a7a-bb89-a5cee47ea675 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.574300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198ccac-e2ce-4a7a-bb89-a5cee47ea675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.606444 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9198ccac-e2ce-4a7a-bb89-a5cee47ea675 None None] MFA Rules not processed for user `58f08358eb494d29a469235cb9671d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:31.607749 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9198ccac-e2ce-4a7a-bb89-a5cee47ea675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:31.687134 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1462/2898] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:31.699668 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:31.702072 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:31.784844 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19752b-5a97-44d6-abc4-bdf982233444 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:31.792297 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:31.792994 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:31.793281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:31.793553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:31.850664 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:31.852086 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:31.860804 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1437/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:33.099970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:33.099970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:33.099970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:33.121165 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:33.122325 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:33.180234 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:33.194129 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1463/2900] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:33.212027 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:33.213860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:33.258366 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:33.296661 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58077f7-f24c-4ed3-88dc-de890b814b7b service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:33.302829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:33.303270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:33.303541 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:33.303807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:33.312189 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:33.313738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea58bd-812f-4a12-a870-303441c13d86 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:33.324240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1438/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:36.148141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:36.149594 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:36.164474 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b3f6-3d4e-4948-be1a-9cac0e87c583 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:36.168419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:36.169019 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:36.169512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:36.170792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:36.181670 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:36.183200 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:36.194265 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1464/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:36.282568 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:36.283273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:36.283273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:36.304150 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:36.305353 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:36.315801 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1439/2903] 10.222.0.65 () {58 vars in 1016 bytes} [Mon Sep 19 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:36.360602 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:36.362779 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:36.380881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ba565-7271-4386-9186-02760b8a3d8d service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:36.390547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:36.391495 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:36.392154 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:36.392635 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:36.404612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:36.406215 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c15c73-cb49-47e0-956c-691b8380af69 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:36.418174 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1465/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:41.244286 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:41.254809 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550cae8-34c6-4dfc-863e-5d97b3c36970 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:41.260169 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:41.260802 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:41.261085 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:41.261389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] PATH_INFO: `/v3/users/c4fd68b1533743779078186db8f40634` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:41.262558 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fd68b1533743779078186db8f40634)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:41.264490 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:41.330351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fd68b1533743779078186db8f40634'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:41.338979 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fd68b1533743779078186db8f40634'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:41.339635 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fd68b1533743779078186db8f40634'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:41.340240 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fd68b1533743779078186db8f40634'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:41.348567 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fd68b1533743779078186db8f40634'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:41.369327 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1440/2905] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:23:41 2022] DELETE /identity/v3/users/c4fd68b1533743779078186db8f40634 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:23:41.373972 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:41.374578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:41.374578 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:41.396469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:41.397689 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:41.484117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1466/2906] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:23:41.505823 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:41.507267 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:41.575351 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6e016-6bcf-473f-aa4e-bff802d9eb9f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:41.579210 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:41.579842 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:41.580117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:41.580389 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:41.590869 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:41.592384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:41.604157 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1441/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:41.916903 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:41.918625 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:41.935790 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528fc8-eeb3-474c-ab41-a69e4bbd1350 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:41.944457 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:41.944988 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:41.945365 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:41.945545 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] PATH_INFO: `/v3/projects/0317ef566f164e5592d7bcfaf528e655` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:41.946750 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0317ef566f164e5592d7bcfaf528e655)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:41.948667 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:42.006752 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0317ef566f164e5592d7bcfaf528e655', 'request_id': 'req-7052797a-7e07-4fba-a26d-35b2e1969341'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.015920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0317ef566f164e5592d7bcfaf528e655', 'request_id': 'req-7052797a-7e07-4fba-a26d-35b2e1969341'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.025255 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0317ef566f164e5592d7bcfaf528e655', 'request_id': 'req-7052797a-7e07-4fba-a26d-35b2e1969341'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.048051 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] The token cache is being invalidate because project 0317ef566f164e5592d7bcfaf528e655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:23:42.048505 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.049738 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.051919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1467/2908] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:23:41 2022] DELETE /identity/v3/projects/0317ef566f164e5592d7bcfaf528e655 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:23:42.056142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:42.067207 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66567a-3436-4988-bd70-5d8f414564ee service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:42.102519 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:42.140723 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:42.141362 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:42.141642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:42.141906 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] PATH_INFO: `/v3/users/58f08358eb494d29a469235cb9671d1e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:42.143628 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f08358eb494d29a469235cb9671d1e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:42.145550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:42.212590 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f08358eb494d29a469235cb9671d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.226298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f08358eb494d29a469235cb9671d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.227876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f08358eb494d29a469235cb9671d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.228945 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f08358eb494d29a469235cb9671d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.239142 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-49c1eea4-651c-426f-af88-abb1d4e81106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f08358eb494d29a469235cb9671d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.261265 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1442/2909] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:23:42 2022] DELETE /identity/v3/users/58f08358eb494d29a469235cb9671d1e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:42.581082 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:42.582586 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:42.595801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052797a-7e07-4fba-a26d-35b2e1969341 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:42.671313 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:42.688820 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:42.689460 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:42.689739 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:42.690010 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] PATH_INFO: `/v3/projects/323901c9341a4038943915f3c8d4d816` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:42.691186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323901c9341a4038943915f3c8d4d816)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:42.693678 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:42.756751 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323901c9341a4038943915f3c8d4d816', 'request_id': 'req-339694cb-e5f0-4626-9dbc-0e854a7886f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.773922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323901c9341a4038943915f3c8d4d816', 'request_id': 'req-339694cb-e5f0-4626-9dbc-0e854a7886f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.783018 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323901c9341a4038943915f3c8d4d816', 'request_id': 'req-339694cb-e5f0-4626-9dbc-0e854a7886f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.800787 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] The token cache is being invalidate because project 323901c9341a4038943915f3c8d4d816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:23:42.801065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.801745 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-339694cb-e5f0-4626-9dbc-0e854a7886f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:23:42.803795 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1468/2910] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:23:42 2022] DELETE /identity/v3/projects/323901c9341a4038943915f3c8d4d816 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:42.810051 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:42.810421 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:42.810719 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:42.832860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:42.834024 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:42.914520 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1443/2911] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:23:42.926693 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:42.927076 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:42.928305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:42.952575 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:42.953840 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:42.968709 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1469/2912] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:23:42.973289 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:42.984114 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c521d5-05f8-497e-8ca5-823e80823795 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:42.988954 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:42.989600 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:42.990597 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:42.990877 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:42.991528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:23:42.991829 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:42.993431 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.006762 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1444/2913] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:23:43.011763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.022103 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159b2e-8bc1-4312-bb74-fc28d2929d7d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.028547 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.029168 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.029440 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.029708 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.030348 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.032338 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.077507 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1470/2914] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:23:43 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:23:43.083076 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.093609 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31f16-d61a-4492-8a59-a6f8ea157a4a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.131787 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:43.159915 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.160515 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.160794 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.161067 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.162255 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.164198 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.190132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1445/2915] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:23:43 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:23:43.195707 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.206612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98959a-32b1-4d84-9f8c-ea37fe79afdf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.211356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.212208 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.212671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.213074 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.214090 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.215844 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.231080 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1471/2916] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:43.236508 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.250907 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343231c-8877-4600-b9c0-0678bd229dc4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.255738 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.256337 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.256613 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.257206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.257514 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.259172 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07932b-1559-4ef5-87e1-8bac4469134b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.271390 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1446/2917] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:23:43.275855 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.290237 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e480fca-df2a-43fc-8dc8-ea5ebdb62868 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.297148 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.297809 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.298085 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.298356 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] PATH_INFO: `/v3/projects/cadc3a2b82484c2ea12c08d611891b01/users/2924fb8445ae4c56a77ed05f53638529/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.325781 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadc3a2b82484c2ea12c08d611891b01, user_id=2924fb8445ae4c56a77ed05f53638529, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.333919 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.356920 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1472/2918] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:23:43 2022] PUT /identity/v3/projects/cadc3a2b82484c2ea12c08d611891b01/users/2924fb8445ae4c56a77ed05f53638529/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:23:43.374765 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.375075 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.375294 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.428368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] MFA Rules not processed for user `2924fb8445ae4c56a77ed05f53638529`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:23:43.429619 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:43.502341 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1447/2919] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 16:23:43.517582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:43.519397 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:43.583792 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0a056-031d-4f81-998c-53c0830ab97e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:43.587673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50a08aac9b9240338d0fec3b5ce7e285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:43.588214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:43.588487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:43.588758 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:43.601390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:43.602887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:43.613065 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1473/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:23:45.291929 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:45.294105 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:45.372215 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3eed9-4c9d-48f0-a116-149cd5d1cacf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:45.378910 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:45.379545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:45.379814 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:45.380106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:45.382000 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:45.450057 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:45.479653 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:45.482090 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:45.501312 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1448/2921] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 16:23:46.757038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:23:46.769887 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec649fb-e576-490b-bbb1-fe133de467ce service glance] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:23:46.775185 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:23:46.776654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:23:46.777201 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:23:46.777480 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:23:46.779339 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:23:46.801785 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:23:46.803334 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:23:46.808252 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:46.822799 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1474/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:23:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:23:55.493308 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:23:56.824671 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:06.481217 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:06.482771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:06.551808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4f01-312a-43f8-8e8b-69f64cd5da8b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:06.556393 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:06.557023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:06.557298 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:06.557569 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] PATH_INFO: `/v3/users/777bed5cc15243449cca839b29d13db5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:06.558805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777bed5cc15243449cca839b29d13db5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:06.560730 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:06.612141 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777bed5cc15243449cca839b29d13db5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:06.621646 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777bed5cc15243449cca839b29d13db5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:06.622314 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777bed5cc15243449cca839b29d13db5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:06.623014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777bed5cc15243449cca839b29d13db5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:06.631112 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777bed5cc15243449cca839b29d13db5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:06.649200 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1449/2923] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:24:06 2022] DELETE /identity/v3/users/777bed5cc15243449cca839b29d13db5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:06.854186 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:06.874872 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7c3-a3ff-41e5-8524-1caea8154996 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:06.945522 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:06.946178 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:06.946476 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:06.946810 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] PATH_INFO: `/v3/projects/67bb7aac3b5c4755b29ce88b3af1e3e3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:06.947969 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bb7aac3b5c4755b29ce88b3af1e3e3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:06.949952 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:06.999973 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bb7aac3b5c4755b29ce88b3af1e3e3', 'request_id': 'req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:07.011108 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bb7aac3b5c4755b29ce88b3af1e3e3', 'request_id': 'req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:07.017557 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bb7aac3b5c4755b29ce88b3af1e3e3', 'request_id': 'req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:07.029970 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] The token cache is being invalidate because project 67bb7aac3b5c4755b29ce88b3af1e3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:24:07.030449 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:07.031393 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1ae2cbbd-fd98-47f9-857e-9c6bc5b62659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:07.033183 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1475/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:24:06 2022] DELETE /identity/v3/projects/67bb7aac3b5c4755b29ce88b3af1e3e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:08.957209 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:08.959268 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:08.972586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0a85-8603-410f-a826-98b45fa071c4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.029126 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.029771 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.030038 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.030305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] PATH_INFO: `/v3/users/2924fb8445ae4c56a77ed05f53638529` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.031452 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2924fb8445ae4c56a77ed05f53638529)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.033642 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.057368 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:09.086206 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2924fb8445ae4c56a77ed05f53638529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.093205 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2924fb8445ae4c56a77ed05f53638529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.093860 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2924fb8445ae4c56a77ed05f53638529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.094450 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2924fb8445ae4c56a77ed05f53638529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.102161 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2924fb8445ae4c56a77ed05f53638529'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.120402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1450/2925] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:24:08 2022] DELETE /identity/v3/users/2924fb8445ae4c56a77ed05f53638529 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:09.124914 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.125402 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.125517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.144555 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:24:09.146277 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:09.204796 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1476/2926] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:24:09.215113 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.216522 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:09.274666 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ddac8-b2af-4624-bd19-0bce8e7c8a5e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.278373 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.279007 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.279281 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.279550 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.289413 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.290870 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748994-4812-4cdc-b044-6748b9800a1d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.300153 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1451/2927] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:24:09.570385 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.571938 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:09.585964 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a5cf-5f35-4c5d-b990-aa61ff0301a0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.590747 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.591387 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.591658 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.591934 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] PATH_INFO: `/v3/projects/cadc3a2b82484c2ea12c08d611891b01` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.593047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadc3a2b82484c2ea12c08d611891b01)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.594983 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.626264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:09.645238 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadc3a2b82484c2ea12c08d611891b01', 'request_id': 'req-46517f29-4a50-46ef-bbb2-861a5b187e65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.652600 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadc3a2b82484c2ea12c08d611891b01', 'request_id': 'req-46517f29-4a50-46ef-bbb2-861a5b187e65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.658257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadc3a2b82484c2ea12c08d611891b01', 'request_id': 'req-46517f29-4a50-46ef-bbb2-861a5b187e65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.669624 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] The token cache is being invalidate because project cadc3a2b82484c2ea12c08d611891b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:24:09.669924 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.670582 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46517f29-4a50-46ef-bbb2-861a5b187e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:09.672059 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1477/2928] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:24:09 2022] DELETE /identity/v3/projects/cadc3a2b82484c2ea12c08d611891b01 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:09.677811 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.678093 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.678370 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.698180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:24:09.699409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:09.760325 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1452/2929] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:24:09.769615 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.769892 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.770171 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.789939 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:24:09.791159 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:09.798995 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1478/2930] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:24:09.804059 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.813846 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0c03-c041-44de-a9d1-0f37fdc5cdd0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.819023 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.819620 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.819895 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.820168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.820805 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:24:09.821106 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.822725 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.834270 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1453/2931] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Sep 19 16:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:24:09.838769 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.847955 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b040a-3a30-4ebc-8115-a39d9b3aa985 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.852673 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.853260 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.853533 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.853801 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.854414 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.856330 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.884257 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1479/2932] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Sep 19 16:24:09 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:24:09.888412 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.898359 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0821692-9f59-458b-99c9-a3f5cdc92a49 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:09.925278 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:09.957058 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:09.957660 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:09.958208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:09.958208 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:09.958863 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:09.960773 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:09.982876 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1454/2933] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Sep 19 16:24:09 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:24:09.988512 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:09.999875 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e38e-9f99-4df8-9c07-4c2a2e81353c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:10.004367 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:10.005487 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:10.005753 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:10.006013 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:10.006669 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:10.008711 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:10.018464 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1480/2934] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:24:10.022426 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:10.032502 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3af9e-00e2-43bf-a7fa-a48599a86ddd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:10.038222 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:10.038855 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:10.039132 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:10.039402 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:10.040060 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:10.041638 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865cd36-03be-46a5-86b3-adb3ee360813 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:10.052813 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1455/2935] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Sep 19 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:24:10.057073 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:10.067163 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a54de-8bb4-47e9-adb6-e9692bfcf543 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:10.072980 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:10.073661 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:10.073942 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:10.074233 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] PATH_INFO: `/v3/projects/6eaffdee42204f42b56a130ddacd24f9/users/6bdf77ca1f9b4cb3954e924de1da7c4f/roles/a91a89818523427f9295a540fa435066` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:10.090828 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaffdee42204f42b56a130ddacd24f9, user_id=6bdf77ca1f9b4cb3954e924de1da7c4f, role_id=a91a89818523427f9295a540fa435066)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:10.093530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:10.106961 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1481/2936] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Sep 19 16:24:10 2022] PUT /identity/v3/projects/6eaffdee42204f42b56a130ddacd24f9/users/6bdf77ca1f9b4cb3954e924de1da7c4f/roles/a91a89818523427f9295a540fa435066 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:24:10.119048 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:10.119641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:10.119641 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:10.147896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] MFA Rules not processed for user `6bdf77ca1f9b4cb3954e924de1da7c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:24:10.149163 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:10.225381 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1456/2937] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:24:10.236214 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:10.237929 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:10.294504 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b47e8-7d20-4cd2-a0ba-b9d5eb4c1cea admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:10.298028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a2f331dfa2463a9af3282f8d9569e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:10.298650 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:10.298923 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:10.299190 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:10.308100 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:10.309510 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a42c2-0105-40ea-9a84-8d07e999e712 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:10.318654 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1482/2938] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:24:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:24:20.221968 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:20.314321 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:20.488149 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:20.553273 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632e647-de13-4a7c-995e-4cd4380ba283 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:20.557880 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:20.558545 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:20.558828 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:20.559100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] PATH_INFO: `/v3/users/6bdf77ca1f9b4cb3954e924de1da7c4f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:20.560239 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdf77ca1f9b4cb3954e924de1da7c4f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:20.562179 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:20.609318 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdf77ca1f9b4cb3954e924de1da7c4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:20.617808 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdf77ca1f9b4cb3954e924de1da7c4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:20.618447 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdf77ca1f9b4cb3954e924de1da7c4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:20.619100 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdf77ca1f9b4cb3954e924de1da7c4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:20.626201 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdf77ca1f9b4cb3954e924de1da7c4f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:20.644134 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1457/2939] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:24:20 2022] DELETE /identity/v3/users/6bdf77ca1f9b4cb3954e924de1da7c4f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:20.649744 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:20.650141 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:20.650511 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:20.670296 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] MFA Rules not processed for user `00151915182b4e0ba158485ecbf2ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:24:20.671583 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:20.734727 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1483/2940] 10.222.0.27 () {58 vars in 958 bytes} [Mon Sep 19 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 16:24:20.744663 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:20.746388 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:20.805030 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b477-8351-4daf-8ceb-8b31872cc67e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:20.808806 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:20.809409 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:20.809682 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:20.809950 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:20.819747 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:20.821180 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:20.830985 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1458/2941] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:24:21.107417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:21.108963 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:21.122412 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da912c-dd70-4cca-8537-d704aef4db84 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:21.127565 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:21.128390 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:21.128771 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:21.129117 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] PATH_INFO: `/v3/projects/6eaffdee42204f42b56a130ddacd24f9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:21.131574 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaffdee42204f42b56a130ddacd24f9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:21.135431 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:21.186544 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaffdee42204f42b56a130ddacd24f9', 'request_id': 'req-7536e948-e33d-4d0f-ad35-29e517cbfa6b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:21.196173 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaffdee42204f42b56a130ddacd24f9', 'request_id': 'req-7536e948-e33d-4d0f-ad35-29e517cbfa6b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:21.201136 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaffdee42204f42b56a130ddacd24f9', 'request_id': 'req-7536e948-e33d-4d0f-ad35-29e517cbfa6b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:21.214974 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] The token cache is being invalidate because project 6eaffdee42204f42b56a130ddacd24f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:24:21.215264 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:21.215922 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:24:21.217450 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1484/2942] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:24:21 2022] DELETE /identity/v3/projects/6eaffdee42204f42b56a130ddacd24f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:24:30.826553 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:31.211802 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:24:55.305946 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:24:55.314887 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1668c7-c90a-4ddd-8faf-d0dc3bfb1e6a service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:24:55.364703 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d6d914a7228452d960c12c0d5db44aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:24:55.365309 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:24:55.365586 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:24:55.365856 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:24:55.368446 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:24:55.377824 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:24:55.379269 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:24:55.387144 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1459/2943] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:24:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:25:05.383608 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=26 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:25:15.055881 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:15.057305 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:15.148047 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536e948-e33d-4d0f-ad35-29e517cbfa6b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:15.164140 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe2a726da0f429ba1de83b2ff0ea950', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:15.164763 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:15.165038 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:15.165309 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:15.167275 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:15.185007 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:15.187620 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:15.204417 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1485/2944] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:25:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:25:25.002031 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:25.004151 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:25.063011 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:25.064469 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:25.117980 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a867bd-aa35-434a-8d9c-8a4cdf05aa35 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:25.125109 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:25.126042 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:25.126328 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:25.126693 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:25.129556 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:25.142741 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:25.144417 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:25.155305 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1460/2945] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:25:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:25:25.160452 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c2ef-96d1-427e-b008-dbc698e599bd service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:25.165407 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:25.166061 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:25.166349 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:25.166656 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] PATH_INFO: `/v3/users/f38327e2b16b4b59876dd32173480134` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:25.167806 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38327e2b16b4b59876dd32173480134)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:25.170372 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:25.218351 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38327e2b16b4b59876dd32173480134'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.225269 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38327e2b16b4b59876dd32173480134'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.225862 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38327e2b16b4b59876dd32173480134'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.226461 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38327e2b16b4b59876dd32173480134'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.233530 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38327e2b16b4b59876dd32173480134'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.253419 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1486/2946] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:25:25 2022] DELETE /identity/v3/users/f38327e2b16b4b59876dd32173480134 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:25:25.423665 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:25.435589 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162951-745f-42a9-8909-745e75426ad8 service placement] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:25.493346 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:25.493965 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:25.494241 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:25.494533 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] PATH_INFO: `/v3/projects/135d132dd537474785e4684d9776d5c0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:25.495654 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135d132dd537474785e4684d9776d5c0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:25.497528 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:25.544701 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135d132dd537474785e4684d9776d5c0', 'request_id': 'req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.552667 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135d132dd537474785e4684d9776d5c0', 'request_id': 'req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.558306 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135d132dd537474785e4684d9776d5c0', 'request_id': 'req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.569837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] The token cache is being invalidate because project 135d132dd537474785e4684d9776d5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:25:25.570117 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.570777 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.572242 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1461/2947] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:25:25 2022] DELETE /identity/v3/projects/135d132dd537474785e4684d9776d5c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:25:25.576949 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:25.578362 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:25.587556 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:25:25.591612 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70200b-c851-4dfe-acd9-55bdc38caa57 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:25.649517 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:25.650135 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:25.650416 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:25.650723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] PATH_INFO: `/v3/users/65b7305dd6594712a87ec82fe54da72b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:25.651832 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b7305dd6594712a87ec82fe54da72b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:25.653725 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:25.700856 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b7305dd6594712a87ec82fe54da72b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.708619 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b7305dd6594712a87ec82fe54da72b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.709300 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b7305dd6594712a87ec82fe54da72b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.709907 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b7305dd6594712a87ec82fe54da72b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.716723 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b7305dd6594712a87ec82fe54da72b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:25.733314 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1487/2948] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Sep 19 16:25:25 2022] DELETE /identity/v3/users/65b7305dd6594712a87ec82fe54da72b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:25:25.905706 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:25:25.907168 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:25:25.920822 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f859a3f-e9b0-4e39-a50b-3eb48c746bb6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:25:25.938992 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:25:25.980384 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00151915182b4e0ba158485ecbf2ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86142456f2d74608ba47355a3c5212f1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:25:25.981014 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:25:25.981290 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:25:25.981560 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] PATH_INFO: `/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:25:25.983196 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42331934dc947dabd90a9e5a8bd5fbf)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:25:25.985123 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:25:26.035896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42331934dc947dabd90a9e5a8bd5fbf', 'request_id': 'req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:26.043837 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42331934dc947dabd90a9e5a8bd5fbf', 'request_id': 'req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:26.049835 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42331934dc947dabd90a9e5a8bd5fbf', 'request_id': 'req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:26.060896 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] The token cache is being invalidate because project e42331934dc947dabd90a9e5a8bd5fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 16:25:26.061174 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:26.061786 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6c0a2c36-5d60-4a4e-98b0-cfa903967c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 16:25:26.063263 dv-cinder-858370-2-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1462/2949] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Sep 19 16:25:25 2022] DELETE /identity/v3/projects/e42331934dc947dabd90a9e5a8bd5fbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:25:35.729940 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:25:36.057807 dv-cinder-858370-2-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:26:55.568640 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:26:55.570040 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:26:55.639509 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d0b0-ddbc-4910-9e14-8c3be9950cd6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:26:55.700028 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75492a4f8b854a78be8bcf582e4732d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9302a86cb1744a22897c0864f7cfed4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:26:55.700634 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:26:55.700913 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:26:55.701187 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:26:55.703243 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:26:55.715340 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:26:55.716909 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4464f-264c-48ba-a5d4-f245972991fb service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:26:55.726734 dv-cinder-858370-2-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1488/2950] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Sep 19 16:26:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 16:27:05.722579 dv-cinder-858370-2-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=58 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}